2026-03-30 07:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 07:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 07:30:05 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-30 07:30:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-30 07:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 07:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 07:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 07:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 07:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: f17706d15ddcdd75
2026-03-30 07:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 07:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-30T07_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 07:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 07:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 07:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-30 07:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 07:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 07:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 07:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 07:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 07:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 07:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 07:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 07:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 07:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 07:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 07:30:16 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 7177 | hits on page: 40
2026-03-30 07:30:16 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 07:30:16 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 07:30:16 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG94099%27 HTTP/1.1" 200 None
2026-03-30 07:30:16 [auto1.de] INFO: Scrape type for TG94099: 2
2026-03-30 07:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 815fac90-586a-58d8-888b-d23352d975e5 with identifier: TG94099
2026-03-30 07:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 815fac90-586a-58d8-888b-d23352d975e5 with scrape type 2
2026-03-30 07:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 815fac90-586a-58d8-888b-d23352d975e5 with scrape type 2
2026-03-30 07:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 815fac90-586a-58d8-888b-d23352d975e5, identifier: TG94099
2026-03-30 07:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 815fac90-586a-58d8-888b-d23352d975e5 with identifier: TG94099
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 07:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 07:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 815fac90-586a-58d8-888b-d23352d975e5 with identifier: TG94099
2026-03-30 07:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 815fac90-586a-58d8-888b-d23352d975e5 with identifier: TG94099 to the API
2026-03-30 07:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:56:37Z',
 'fuel_type': 'diesel',
 'id': '815fac90-586a-58d8-888b-d23352d975e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG94099',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 196836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI clean diesel quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2015}
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG94099%27 HTTP/1.1" 200 None
2026-03-30 07:30:19 [auto1.de] INFO: Saving data for TG94099: {'auction_closing_time': 1774972597.0, 'created_time': 1773398499.402205, 'last_price_update_time': 1774855819.88682}
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG94099') HTTP/1.1" 204 0
2026-03-30 07:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:19 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-30 07:30:19 [auto1.de] INFO: Scrape type for YU83796: 2
2026-03-30 07:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d915845-47d4-575a-9ef2-ce50756b063a with identifier: YU83796
2026-03-30 07:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d915845-47d4-575a-9ef2-ce50756b063a with scrape type 2
2026-03-30 07:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d915845-47d4-575a-9ef2-ce50756b063a with scrape type 2
2026-03-30 07:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d915845-47d4-575a-9ef2-ce50756b063a, identifier: YU83796
2026-03-30 07:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d915845-47d4-575a-9ef2-ce50756b063a with identifier: YU83796
2026-03-30 07:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 07:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d915845-47d4-575a-9ef2-ce50756b063a with identifier: YU83796
2026-03-30 07:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d915845-47d4-575a-9ef2-ce50756b063a with identifier: YU83796 to the API
2026-03-30 07:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:30:29Z',
 'fuel_type': 'petrol',
 'id': '9d915845-47d4-575a-9ef2-ce50756b063a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU83796',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 138971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2019}
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-30 07:30:21 [auto1.de] INFO: Saving data for YU83796: {'auction_closing_time': 1774971029.0, 'created_time': 1773301410.665746, 'last_price_update_time': 1774855821.688696}
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU83796') HTTP/1.1" 204 0
2026-03-30 07:30:21 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 07:30:21 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 07:30:21 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-30 07:30:21 [auto1.de] INFO: Scrape type for ZL07849: 2
2026-03-30 07:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9734d0-7374-57dc-ace1-25ff9aa46174 with identifier: ZL07849
2026-03-30 07:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9734d0-7374-57dc-ace1-25ff9aa46174 with scrape type 2
2026-03-30 07:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d9734d0-7374-57dc-ace1-25ff9aa46174 with scrape type 2
2026-03-30 07:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d9734d0-7374-57dc-ace1-25ff9aa46174, identifier: ZL07849
2026-03-30 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d9734d0-7374-57dc-ace1-25ff9aa46174 with identifier: ZL07849
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d9734d0-7374-57dc-ace1-25ff9aa46174 with identifier: ZL07849
2026-03-30 07:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d9734d0-7374-57dc-ace1-25ff9aa46174 with identifier: ZL07849 to the API
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:39:41Z',
 'fuel_type': 'diesel',
 'id': '2d9734d0-7374-57dc-ace1-25ff9aa46174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL07849',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 226026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-30 07:30:22 [auto1.de] INFO: Saving data for ZL07849: {'auction_closing_time': 1774971581.0, 'created_time': 1773427383.509117, 'last_price_update_time': 1774855822.369572}
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL07849') HTTP/1.1" 204 0
2026-03-30 07:30:22 [auto1.de] INFO: Found listing with ID: CK09368
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK09368%27 HTTP/1.1" 200 None
2026-03-30 07:30:22 [auto1.de] INFO: Scrape type for CK09368: 2
2026-03-30 07:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with identifier: CK09368
2026-03-30 07:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with scrape type 2
2026-03-30 07:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with scrape type 2
2026-03-30 07:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a943a31b-363e-54b5-b8f8-800e3b7ef4b9, identifier: CK09368
2026-03-30 07:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with identifier: CK09368
2026-03-30 07:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with identifier: CK09368
2026-03-30 07:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a943a31b-363e-54b5-b8f8-800e3b7ef4b9 with identifier: CK09368 to the API
2026-03-30 07:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:01:28Z',
 'fuel_type': 'petrol',
 'id': 'a943a31b-363e-54b5-b8f8-800e3b7ef4b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK09368',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 150106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-31',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK09368%27 HTTP/1.1" 200 None
2026-03-30 07:30:23 [auto1.de] INFO: Saving data for CK09368: {'auction_closing_time': 1774969288.0, 'created_time': 1773775784.477167, 'last_price_update_time': 1774855823.962438}
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK09368') HTTP/1.1" 204 0
2026-03-30 07:30:23 [auto1.de] INFO: Found listing with ID: TX17036
2026-03-30 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX17036%27 HTTP/1.1" 200 None
2026-03-30 07:30:24 [auto1.de] INFO: Scrape type for TX17036: 2
2026-03-30 07:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with identifier: TX17036
2026-03-30 07:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with scrape type 2
2026-03-30 07:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with scrape type 2
2026-03-30 07:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b871fce-7ac8-5ea8-9323-18c044f1caa9, identifier: TX17036
2026-03-30 07:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with identifier: TX17036
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 07:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with identifier: TX17036
2026-03-30 07:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b871fce-7ac8-5ea8-9323-18c044f1caa9 with identifier: TX17036 to the API
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:39:43Z',
 'fuel_type': 'petrol',
 'id': '1b871fce-7ac8-5ea8-9323-18c044f1caa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX17036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 65426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2007}
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX17036%27 HTTP/1.1" 200 None
2026-03-30 07:30:24 [auto1.de] INFO: Saving data for TX17036: {'auction_closing_time': 1774971583.0, 'created_time': 1773514159.117069, 'last_price_update_time': 1774855824.880335}
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX17036') HTTP/1.1" 204 0
2026-03-30 07:30:24 [auto1.de] INFO: Found listing with ID: NH50671
2026-03-30 07:30:24 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-30 07:30:24 [auto1.de] INFO: Found listing with ID: KT14337
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT14337%27 HTTP/1.1" 200 None
2026-03-30 07:30:24 [auto1.de] INFO: Scrape type for KT14337: 2
2026-03-30 07:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180c897b-9a7a-5c82-8747-d86b98b67223 with identifier: KT14337
2026-03-30 07:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180c897b-9a7a-5c82-8747-d86b98b67223 with scrape type 2
2026-03-30 07:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180c897b-9a7a-5c82-8747-d86b98b67223 with scrape type 2
2026-03-30 07:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 180c897b-9a7a-5c82-8747-d86b98b67223, identifier: KT14337
2026-03-30 07:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 180c897b-9a7a-5c82-8747-d86b98b67223 with identifier: KT14337
2026-03-30 07:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 180c897b-9a7a-5c82-8747-d86b98b67223 with identifier: KT14337
2026-03-30 07:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 180c897b-9a7a-5c82-8747-d86b98b67223 with identifier: KT14337 to the API
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:24:48Z',
 'fuel_type': 'petrol',
 'id': '180c897b-9a7a-5c82-8747-d86b98b67223',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT14337',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 192909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-19',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 5 Star Edition 2WD',
 'transmission': 'manual',
 'trim': '5 Star Edition 2WD',
 'year': 2012}
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT14337%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Saving data for KT14337: {'auction_closing_time': 1774970688.0, 'created_time': 1773860592.462188, 'last_price_update_time': 1774855825.611602}
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT14337') HTTP/1.1" 204 0
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: VP04465
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: SE69152
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE69152%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for SE69152: 1
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: UH00780
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00780%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for UH00780: 1
2026-03-30 07:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: NN66793
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66793%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for NN66793: 1
2026-03-30 07:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: MB72804
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: XL83626
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH44567%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for NH44567: 1
2026-03-30 07:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC35240%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for RC35240: 1
2026-03-30 07:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:25 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN96399%27 HTTP/1.1" 200 None
2026-03-30 07:30:25 [auto1.de] INFO: Scrape type for CN96399: 2
2026-03-30 07:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5382d581-83c0-5079-98a7-e9b7e937ce88 with identifier: CN96399
2026-03-30 07:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5382d581-83c0-5079-98a7-e9b7e937ce88 with scrape type 2
2026-03-30 07:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5382d581-83c0-5079-98a7-e9b7e937ce88 with scrape type 2
2026-03-30 07:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5382d581-83c0-5079-98a7-e9b7e937ce88, identifier: CN96399
2026-03-30 07:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5382d581-83c0-5079-98a7-e9b7e937ce88 with identifier: CN96399
2026-03-30 07:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5382d581-83c0-5079-98a7-e9b7e937ce88 with identifier: CN96399
2026-03-30 07:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5382d581-83c0-5079-98a7-e9b7e937ce88 with identifier: CN96399 to the API
2026-03-30 07:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:41:20Z',
 'fuel_type': 'petrol',
 'id': '5382d581-83c0-5079-98a7-e9b7e937ce88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN96399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 31721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN96399%27 HTTP/1.1" 200 None
2026-03-30 07:30:27 [auto1.de] INFO: Saving data for CN96399: {'auction_closing_time': 1774971680.0, 'created_time': 1774263325.953387, 'last_price_update_time': 1774855827.176001}
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN96399') HTTP/1.1" 204 0
2026-03-30 07:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53160%27 HTTP/1.1" 200 None
2026-03-30 07:30:27 [auto1.de] INFO: Scrape type for BR53160: 1
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: CX00387
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX00387%27 HTTP/1.1" 200 None
2026-03-30 07:30:27 [auto1.de] INFO: Scrape type for CX00387: 1
2026-03-30 07:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: SA09294
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: US58549
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: XS09920
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: TB77328
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77328%27 HTTP/1.1" 200 None
2026-03-30 07:30:27 [auto1.de] INFO: Scrape type for TB77328: 1
2026-03-30 07:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 07:30:27 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE75426%27 HTTP/1.1" 200 None
2026-03-30 07:30:27 [auto1.de] INFO: Scrape type for RE75426: 2
2026-03-30 07:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef280766-6791-53cc-844d-c63ede181a97 with identifier: RE75426
2026-03-30 07:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef280766-6791-53cc-844d-c63ede181a97 with scrape type 2
2026-03-30 07:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef280766-6791-53cc-844d-c63ede181a97 with scrape type 2
2026-03-30 07:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef280766-6791-53cc-844d-c63ede181a97, identifier: RE75426
2026-03-30 07:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef280766-6791-53cc-844d-c63ede181a97 with identifier: RE75426
2026-03-30 07:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef280766-6791-53cc-844d-c63ede181a97 with identifier: RE75426
2026-03-30 07:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef280766-6791-53cc-844d-c63ede181a97 with identifier: RE75426 to the API
2026-03-30 07:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:53:22Z',
 'fuel_type': 'diesel',
 'id': 'ef280766-6791-53cc-844d-c63ede181a97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE75426',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 270481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-08',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Beach',
 'transmission': 'manual',
 'trim': 'Beach',
 'year': 2007}
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE75426%27 HTTP/1.1" 200 None
2026-03-30 07:30:30 [auto1.de] INFO: Saving data for RE75426: {'auction_closing_time': 1774972402.0, 'created_time': 1773467161.74964, 'last_price_update_time': 1774855830.269132}
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE75426') HTTP/1.1" 204 0
2026-03-30 07:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:30 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML92935%27 HTTP/1.1" 200 None
2026-03-30 07:30:30 [auto1.de] INFO: Scrape type for ML92935: 2
2026-03-30 07:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6950ff0-2691-5019-9f53-9590276a11cd with identifier: ML92935
2026-03-30 07:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6950ff0-2691-5019-9f53-9590276a11cd with scrape type 2
2026-03-30 07:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6950ff0-2691-5019-9f53-9590276a11cd with scrape type 2
2026-03-30 07:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6950ff0-2691-5019-9f53-9590276a11cd, identifier: ML92935
2026-03-30 07:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6950ff0-2691-5019-9f53-9590276a11cd with identifier: ML92935
2026-03-30 07:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6950ff0-2691-5019-9f53-9590276a11cd with identifier: ML92935
2026-03-30 07:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6950ff0-2691-5019-9f53-9590276a11cd with identifier: ML92935 to the API
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:24:40Z',
 'fuel_type': 'petrol',
 'id': 'd6950ff0-2691-5019-9f53-9590276a11cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML92935',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 148361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2013}
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML92935%27 HTTP/1.1" 200 None
2026-03-30 07:30:30 [auto1.de] INFO: Saving data for ML92935: {'auction_closing_time': 1774970680.0, 'created_time': 1773773683.240507, 'last_price_update_time': 1774855830.840223}
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML92935') HTTP/1.1" 204 0
2026-03-30 07:30:30 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 7180 | hits on page: 40
2026-03-30 07:30:30 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 07:30:30 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB11032%27 HTTP/1.1" 200 None
2026-03-30 07:30:30 [auto1.de] INFO: Scrape type for SB11032: 2
2026-03-30 07:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with identifier: SB11032
2026-03-30 07:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with scrape type 2
2026-03-30 07:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with scrape type 2
2026-03-30 07:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bedb7b1-a4c6-507a-84ec-e364a8e06f68, identifier: SB11032
2026-03-30 07:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with identifier: SB11032
2026-03-30 07:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with identifier: SB11032
2026-03-30 07:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bedb7b1-a4c6-507a-84ec-e364a8e06f68 with identifier: SB11032 to the API
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:55:44Z',
 'fuel_type': 'diesel',
 'id': '8bedb7b1-a4c6-507a-84ec-e364a8e06f68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB11032',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 217491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB11032%27 HTTP/1.1" 200 None
2026-03-30 07:30:31 [auto1.de] INFO: Saving data for SB11032: {'auction_closing_time': 1774972544.0, 'created_time': 1774636509.751561, 'last_price_update_time': 1774855831.894598}
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB11032') HTTP/1.1" 204 0
2026-03-30 07:30:31 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-30 07:30:31 [auto1.de] INFO: Found listing with ID: KK61253
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK61253%27 HTTP/1.1" 200 None
2026-03-30 07:30:31 [auto1.de] INFO: Scrape type for KK61253: 2
2026-03-30 07:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with identifier: KK61253
2026-03-30 07:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with scrape type 2
2026-03-30 07:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with scrape type 2
2026-03-30 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2a5824-efd0-5273-9d52-c0fcf189b3f3, identifier: KK61253
2026-03-30 07:30:32 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 07:30:32 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH37878%27 HTTP/1.1" 200 None
2026-03-30 07:30:32 [auto1.de] INFO: Scrape type for PH37878: 1
2026-03-30 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with identifier: KK61253
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with identifier: KK61253
2026-03-30 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2a5824-efd0-5273-9d52-c0fcf189b3f3 with identifier: KK61253 to the API
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:46:29Z',
 'fuel_type': 'diesel',
 'id': 'fb2a5824-efd0-5273-9d52-c0fcf189b3f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK61253',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GL-Klasse',
 'odometer': 323944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GL-Klasse GL 320 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2006}
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK61253%27 HTTP/1.1" 200 None
2026-03-30 07:30:32 [auto1.de] INFO: Saving data for KK61253: {'auction_closing_time': 1774971989.0, 'created_time': 1773659717.372528, 'last_price_update_time': 1774855832.500016}
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK61253') HTTP/1.1" 204 0
2026-03-30 07:30:32 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK35526%27 HTTP/1.1" 200 None
2026-03-30 07:30:32 [auto1.de] INFO: Scrape type for KK35526: 2
2026-03-30 07:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba6e5023-3891-522d-a92a-cc10aeed5977 with identifier: KK35526
2026-03-30 07:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6e5023-3891-522d-a92a-cc10aeed5977 with scrape type 2
2026-03-30 07:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba6e5023-3891-522d-a92a-cc10aeed5977 with scrape type 2
2026-03-30 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba6e5023-3891-522d-a92a-cc10aeed5977, identifier: KK35526
2026-03-30 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba6e5023-3891-522d-a92a-cc10aeed5977 with identifier: KK35526
2026-03-30 07:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba6e5023-3891-522d-a92a-cc10aeed5977 with identifier: KK35526
2026-03-30 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba6e5023-3891-522d-a92a-cc10aeed5977 with identifier: KK35526 to the API
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:23:55Z',
 'fuel_type': 'petrol',
 'id': 'ba6e5023-3891-522d-a92a-cc10aeed5977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK35526',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 179024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance',
 'transmission': 'manual',
 'trim': 'Stylance',
 'year': 2007}
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK35526%27 HTTP/1.1" 200 None
2026-03-30 07:30:32 [auto1.de] INFO: Saving data for KK35526: {'auction_closing_time': 1774970635.0, 'created_time': 1774377437.70359, 'last_price_update_time': 1774855832.997614}
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK35526') HTTP/1.1" 204 0
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH44567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE69152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG94099%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for TG94099: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: CK09368
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK09368%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for CK09368: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: TX17036
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX17036%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for TX17036: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: NH50671
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: KT14337
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT14337%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for KT14337: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: VP04465
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: SE69152
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SE69152/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: UH00780
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: NN66793
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: MB72804
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: XL83626
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN96399%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for CN96399: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: CX00387
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: SA09294
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: US58549
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: XS09920
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: TB77328
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE75426%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for RE75426: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML92935%27 HTTP/1.1" 200 None
2026-03-30 07:30:33 [auto1.de] INFO: Scrape type for ML92935: 0
2026-03-30 07:30:33 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH00780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX00387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR53160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN66793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC35240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB77328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH44567> (referer: https://www.auto1.com/v1/car-details-view/NH44567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE69152> (referer: https://www.auto1.com/v1/car-details-view/SE69152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25618685-782d-5e10-b526-94687edf0e1f with identifier: NH44567
2026-03-30 07:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25618685-782d-5e10-b526-94687edf0e1f with scrape type 1
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg not downloaded yet
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_62414e964578e35afb9b858fc5b79fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_62414e964578e35afb9b858fc5b79fc7.jpg not downloaded yet
2026-03-30 07:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH37878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_572070098add9f53d1013b95491bd412.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_572070098add9f53d1013b95491bd412.jpg not downloaded yet
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg not downloaded yet
2026-03-30 07:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc9d5b73-dab5-5db6-9aa6-737fc6ccc024 with identifier: SE69152
2026-03-30 07:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc9d5b73-dab5-5db6-9aa6-737fc6ccc024 with scrape type 1
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc9d5b73-dab5-5db6-9aa6-737fc6ccc024
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_a108a23a2ea4e52affcaa25bcd966825.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_a108a23a2ea4e52affcaa25bcd966825.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_26675168fa37cf937f89b6ac1a701f32.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_26675168fa37cf937f89b6ac1a701f32.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_908028ed996ce6ee9577f48f1eb97152.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_908028ed996ce6ee9577f48f1eb97152.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_eec6e75027ffb3f50b73ed0c203fa2d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_eec6e75027ffb3f50b73ed0c203fa2d0.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_104eb434b31a338e95e535f1fd6de0b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_104eb434b31a338e95e535f1fd6de0b3.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_0e245bdaf35cc023e502b4619af4936f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_0e245bdaf35cc023e502b4619af4936f.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_000767a57e006686904a7620593550ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_000767a57e006686904a7620593550ad.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_267f6257f7b52b7d5c3e142855938e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_267f6257f7b52b7d5c3e142855938e0e.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_e5a9bd35f7aed75771b606a3db8373c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_e5a9bd35f7aed75771b606a3db8373c6.jpg already downloaded
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F9d%252Ff49d4aa9257583dc3125b1065955d8fd%252Fpa%252FSE69152_f463f9103a710b16dc396447a19b6884.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_f463f9103a710b16dc396447a19b6884.jpg already downloaded
2026-03-30 07:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc9d5b73-dab5-5db6-9aa6-737fc6ccc024, identifier: SE69152
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg not downloaded yet
2026-03-30 07:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc9d5b73-dab5-5db6-9aa6-737fc6ccc024 with identifier: SE69152
2026-03-30 07:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc9d5b73-dab5-5db6-9aa6-737fc6ccc024 with identifier: SE69152
2026-03-30 07:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc9d5b73-dab5-5db6-9aa6-737fc6ccc024 with identifier: SE69152 to the API
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE69152>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:22:33Z',
 'fuel_type': 'petrol',
 'id': 'cc9d5b73-dab5-5db6-9aa6-737fc6ccc024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE69152',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 55249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_a108a23a2ea4e52affcaa25bcd966825.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_26675168fa37cf937f89b6ac1a701f32.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_908028ed996ce6ee9577f48f1eb97152.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_eec6e75027ffb3f50b73ed0c203fa2d0.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_104eb434b31a338e95e535f1fd6de0b3.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_0e245bdaf35cc023e502b4619af4936f.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_000767a57e006686904a7620593550ad.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_267f6257f7b52b7d5c3e142855938e0e.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_e5a9bd35f7aed75771b606a3db8373c6.jpg',
                'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_f463f9103a710b16dc396447a19b6884.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_a108a23a2ea4e52affcaa25bcd966825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2025424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_26675168fa37cf937f89b6ac1a701f32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_908028ed996ce6ee9577f48f1eb97152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1931587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_eec6e75027ffb3f50b73ed0c203fa2d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_104eb434b31a338e95e535f1fd6de0b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_0e245bdaf35cc023e502b4619af4936f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1891184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_000767a57e006686904a7620593550ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_267f6257f7b52b7d5c3e142855938e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_e5a9bd35f7aed75771b606a3db8373c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9d5b73-dab5-5db6-9aa6-737fc6ccc024/cc9d5b73-dab5-5db6-9aa6-737fc6ccc024_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/9d/f49d4aa9257583dc3125b1065955d8fd/pa/SE69152_f463f9103a710b16dc396447a19b6884.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2012}
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE69152%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Saving data for SE69152: {'created_time': 1774855835.045534, 'last_price_update_time': 1774855835.045549, 'auction_closing_time': 1774970553.0}
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE69152') HTTP/1.1" 204 0
2026-03-30 07:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX00387> (referer: https://www.auto1.com/v1/car-details-view/CX00387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_489d8700dd13bdacfa7f6d1855919a86.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_489d8700dd13bdacfa7f6d1855919a86.jpg not downloaded yet
2026-03-30 07:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH00780> (referer: https://www.auto1.com/v1/car-details-view/UH00780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN66793> (referer: https://www.auto1.com/v1/car-details-view/NN66793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:35 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 7184 | hits on page: 40
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg not downloaded yet
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE75426%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Scrape type for RE75426: 0
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML92935%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Scrape type for ML92935: 0
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB11032%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Scrape type for SB11032: 0
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 07:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_86fe1fa353a82e3b2221120618a6e036.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_86fe1fa353a82e3b2221120618a6e036.jpg not downloaded yet
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: TS70088
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS70088%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Scrape type for TS70088: 1
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg not downloaded yet
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-30 07:30:35 [auto1.de] INFO: Found listing with ID: ZG29710
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG29710%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [auto1.de] INFO: Scrape type for ZG29710: 2
2026-03-30 07:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a171f0-df03-5545-aebf-033a8f008913 with identifier: ZG29710
2026-03-30 07:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a171f0-df03-5545-aebf-033a8f008913 with scrape type 2
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a171f0-df03-5545-aebf-033a8f008913 with scrape type 2
2026-03-30 07:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4a171f0-df03-5545-aebf-033a8f008913, identifier: ZG29710
2026-03-30 07:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ffeecc-b227-5f58-9d19-439e97466547 with identifier: CX00387
2026-03-30 07:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ffeecc-b227-5f58-9d19-439e97466547 with scrape type 1
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72ffeecc-b227-5f58-9d19-439e97466547
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_bbe98a640eab543b0c1919c3002aa4f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_bbe98a640eab543b0c1919c3002aa4f4.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_7596268803d46b8efcd185e1896cd88b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_7596268803d46b8efcd185e1896cd88b.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_591dd71830f6131009598a5e77fc09bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_591dd71830f6131009598a5e77fc09bb.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_435b9aa4f90fe5c85e5da732392a6aec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_435b9aa4f90fe5c85e5da732392a6aec.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_2b3062299623162e0ee2789474bb32df.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2b3062299623162e0ee2789474bb32df.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_8e4637adf750752824f2fa9a752886b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_8e4637adf750752824f2fa9a752886b3.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_57cbfed1ae42d90e727e96ba4cd2b39e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_57cbfed1ae42d90e727e96ba4cd2b39e.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_2eada98f335d4d0aa076cc0178fd860d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2eada98f335d4d0aa076cc0178fd860d.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_29d67a04c7c4d28f661d7f8a2a366b09.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_29d67a04c7c4d28f661d7f8a2a366b09.jpg already downloaded
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fa1%252Ff4a1b35dbc2b270128fca742dc0225c6%252Fpa%252FCX00387_fd601d675f122bffc2c0abe6feab93d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_fd601d675f122bffc2c0abe6feab93d9.jpg already downloaded
2026-03-30 07:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ffeecc-b227-5f58-9d19-439e97466547, identifier: CX00387
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_3422d0b89ac6cef7be424432862f41ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_3422d0b89ac6cef7be424432862f41ab.jpg not downloaded yet
2026-03-30 07:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4a171f0-df03-5545-aebf-033a8f008913 with identifier: ZG29710
2026-03-30 07:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4a171f0-df03-5545-aebf-033a8f008913 with identifier: ZG29710
2026-03-30 07:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4a171f0-df03-5545-aebf-033a8f008913 with identifier: ZG29710 to the API
2026-03-30 07:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:51:40Z',
 'fuel_type': 'diesel',
 'id': 'c4a171f0-df03-5545-aebf-033a8f008913',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG29710',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 101907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG29710%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Saving data for ZG29710: {'auction_closing_time': 1774972300.0, 'created_time': 1774262657.18853, 'last_price_update_time': 1774855836.128745}
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG29710') HTTP/1.1" 204 0
2026-03-30 07:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ffeecc-b227-5f58-9d19-439e97466547 with identifier: CX00387
2026-03-30 07:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ffeecc-b227-5f58-9d19-439e97466547 with identifier: CX00387
2026-03-30 07:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ffeecc-b227-5f58-9d19-439e97466547 with identifier: CX00387 to the API
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX00387>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:07:22Z',
 'fuel_type': 'petrol',
 'id': '72ffeecc-b227-5f58-9d19-439e97466547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX00387',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 169017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_bbe98a640eab543b0c1919c3002aa4f4.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_7596268803d46b8efcd185e1896cd88b.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_591dd71830f6131009598a5e77fc09bb.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_435b9aa4f90fe5c85e5da732392a6aec.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2b3062299623162e0ee2789474bb32df.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_8e4637adf750752824f2fa9a752886b3.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_57cbfed1ae42d90e727e96ba4cd2b39e.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2eada98f335d4d0aa076cc0178fd860d.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_29d67a04c7c4d28f661d7f8a2a366b09.jpg',
                'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_fd601d675f122bffc2c0abe6feab93d9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_bbe98a640eab543b0c1919c3002aa4f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_7596268803d46b8efcd185e1896cd88b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_591dd71830f6131009598a5e77fc09bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_435b9aa4f90fe5c85e5da732392a6aec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2246666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2b3062299623162e0ee2789474bb32df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_8e4637adf750752824f2fa9a752886b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_57cbfed1ae42d90e727e96ba4cd2b39e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_2eada98f335d4d0aa076cc0178fd860d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2115944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_29d67a04c7c4d28f661d7f8a2a366b09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72ffeecc-b227-5f58-9d19-439e97466547/72ffeecc-b227-5f58-9d19-439e97466547_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/a1/f4a1b35dbc2b270128fca742dc0225c6/pa/CX00387_fd601d675f122bffc2c0abe6feab93d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX00387%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Saving data for CX00387: {'created_time': 1774855836.492177, 'last_price_update_time': 1774855836.492189, 'auction_closing_time': 1774969642.0}
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX00387') HTTP/1.1" 204 0
2026-03-30 07:30:36 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-30 07:30:36 [auto1.de] INFO: Found listing with ID: LZ90334
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ90334%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Scrape type for LZ90334: 1
2026-03-30 07:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with identifier: UH00780
2026-03-30 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with scrape type 1
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_a161c96287740b959cd5c0762205db74.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a161c96287740b959cd5c0762205db74.jpg not downloaded yet
2026-03-30 07:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with identifier: NN66793
2026-03-30 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with scrape type 1
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_c07106592f7eec37323a94af2cc5b232.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_c07106592f7eec37323a94af2cc5b232.jpg not downloaded yet
2026-03-30 07:30:36 [auto1.de] INFO: Found listing with ID: CD25494
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD25494%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Scrape type for CD25494: 1
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg not downloaded yet
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_77f2946d76717a76c8689d561baf2480.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_77f2946d76717a76c8689d561baf2480.jpg not downloaded yet
2026-03-30 07:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC35240> (referer: https://www.auto1.com/v1/car-details-view/RC35240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:36 [auto1.de] INFO: Found listing with ID: XV83798
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83798%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Scrape type for XV83798: 1
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_304d1b6e1ce9955818f839fb865ea243.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_304d1b6e1ce9955818f839fb865ea243.jpg not downloaded yet
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg not downloaded yet
2026-03-30 07:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_62414e964578e35afb9b858fc5b79fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB77328> (referer: https://www.auto1.com/v1/car-details-view/TB77328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:36 [auto1.de] INFO: Found listing with ID: XC52601
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC52601%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [auto1.de] INFO: Scrape type for XC52601: 2
2026-03-30 07:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1072f654-6c58-5b84-986c-766644190322 with identifier: XC52601
2026-03-30 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1072f654-6c58-5b84-986c-766644190322 with scrape type 2
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1072f654-6c58-5b84-986c-766644190322 with scrape type 2
2026-03-30 07:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1072f654-6c58-5b84-986c-766644190322, identifier: XC52601
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_836673094494eb693ce533d9e716af54.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_836673094494eb693ce533d9e716af54.jpg not downloaded yet
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_a53c16e1845cc6b9941e0892ab21306c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_a53c16e1845cc6b9941e0892ab21306c.jpg not downloaded yet
2026-03-30 07:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1072f654-6c58-5b84-986c-766644190322 with identifier: XC52601
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 07:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1072f654-6c58-5b84-986c-766644190322 with identifier: XC52601
2026-03-30 07:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1072f654-6c58-5b84-986c-766644190322 with identifier: XC52601 to the API
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:09:09Z',
 'fuel_type': 'diesel',
 'id': '1072f654-6c58-5b84-986c-766644190322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC52601',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 119139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'BMW 3er 330d GT Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC52601%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [auto1.de] INFO: Saving data for XC52601: {'auction_closing_time': 1774969749.0, 'created_time': 1773686112.175545, 'last_price_update_time': 1774855837.404947}
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC52601') HTTP/1.1" 204 0
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: EA67051
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67051%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [auto1.de] INFO: Scrape type for EA67051: 1
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg not downloaded yet
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_bc859e20e79b8b28db86995586d37fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_bc859e20e79b8b28db86995586d37fea.jpg not downloaded yet
2026-03-30 07:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_489d8700dd13bdacfa7f6d1855919a86.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_c07106592f7eec37323a94af2cc5b232.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: ZB59914
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: TJ43394
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: LS48573
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-30 07:30:37 [auto1.de] INFO: Found listing with ID: EV60549
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV60549%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [auto1.de] INFO: Scrape type for EV60549: 1
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg not downloaded yet
2026-03-30 07:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333c2e54-66f3-5bb7-b3d8-56eda620e372 with identifier: RC35240
2026-03-30 07:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333c2e54-66f3-5bb7-b3d8-56eda620e372 with scrape type 1
2026-03-30 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_259bb88dee568a506636670a33d2d89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_259bb88dee568a506636670a33d2d89b.jpg not downloaded yet
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bebc5ed0>
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 07:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc617d50>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_62414e964578e35afb9b858fc5b79fc7.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_62414e964578e35afb9b858fc5b79fc7.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 132f3c2c-835d-5d5b-9eb6-781127a1b81f with identifier: TB77328
2026-03-30 07:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f with scrape type 1
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg not downloaded yet
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_572070098add9f53d1013b95491bd412.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: XP13096
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP13096%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [auto1.de] INFO: Scrape type for XP13096: 1
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_f0409872ef9b068482fe5672c5f6a777.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_f0409872ef9b068482fe5672c5f6a777.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg not downloaded yet
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS70088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc63c850>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc950b10>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_489d8700dd13bdacfa7f6d1855919a86.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_489d8700dd13bdacfa7f6d1855919a86.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc942b10>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc92da10>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_c07106592f7eec37323a94af2cc5b232.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_c07106592f7eec37323a94af2cc5b232.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca3cf10>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: LZ55907
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ55907%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [auto1.de] INFO: Scrape type for LZ55907: 1
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_9058656f141210e0f84dd2482812ffc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_9058656f141210e0f84dd2482812ffc4.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_217750ad7b2ce68d76bde728db3f82a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_217750ad7b2ce68d76bde728db3f82a6.jpg not downloaded yet
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a161c96287740b959cd5c0762205db74.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_304d1b6e1ce9955818f839fb865ea243.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH37878> (referer: https://www.auto1.com/v1/car-details-view/PH37878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_a53c16e1845cc6b9941e0892ab21306c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: PY11088
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: NC09398
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-30 07:30:38 [auto1.de] INFO: Found listing with ID: SN65200
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN65200%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [auto1.de] INFO: Scrape type for SN65200: 2
2026-03-30 07:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68040a47-5697-54cf-abbe-dd542915a35e with identifier: SN65200
2026-03-30 07:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68040a47-5697-54cf-abbe-dd542915a35e with scrape type 2
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68040a47-5697-54cf-abbe-dd542915a35e with scrape type 2
2026-03-30 07:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68040a47-5697-54cf-abbe-dd542915a35e, identifier: SN65200
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_203499942de41c11ec5fdeef45b4e188.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_203499942de41c11ec5fdeef45b4e188.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg not downloaded yet
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg not downloaded yet
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7c62d0>
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_572070098add9f53d1013b95491bd412.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_572070098add9f53d1013b95491bd412.jpg saved to cache
2026-03-30 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_bc859e20e79b8b28db86995586d37fea.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68040a47-5697-54cf-abbe-dd542915a35e with identifier: SN65200
2026-03-30 07:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68040a47-5697-54cf-abbe-dd542915a35e with identifier: SN65200
2026-03-30 07:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68040a47-5697-54cf-abbe-dd542915a35e with identifier: SN65200 to the API
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:49Z',
 'fuel_type': 'petrol',
 'id': '68040a47-5697-54cf-abbe-dd542915a35e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN65200',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 66975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN65200%27 HTTP/1.1" 200 None
2026-03-30 07:30:39 [auto1.de] INFO: Saving data for SN65200: {'auction_closing_time': 1774972129.0, 'created_time': 1774551893.928878, 'last_price_update_time': 1774855839.393536}
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN65200') HTTP/1.1" 204 0
2026-03-30 07:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:39 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-30 07:30:39 [auto1.de] INFO: Scrape type for GW59315: 2
2026-03-30 07:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e822b522-174b-5e95-ba59-2c1efadefab0 with identifier: GW59315
2026-03-30 07:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e822b522-174b-5e95-ba59-2c1efadefab0 with scrape type 2
2026-03-30 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e822b522-174b-5e95-ba59-2c1efadefab0 with scrape type 2
2026-03-30 07:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e822b522-174b-5e95-ba59-2c1efadefab0, identifier: GW59315
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_1f8cf013e7050bccdc27af8343a3674e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_1f8cf013e7050bccdc27af8343a3674e.jpg not downloaded yet
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg not downloaded yet
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg not downloaded yet
2026-03-30 07:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_836673094494eb693ce533d9e716af54.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e822b522-174b-5e95-ba59-2c1efadefab0 with identifier: GW59315
2026-03-30 07:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e822b522-174b-5e95-ba59-2c1efadefab0 with identifier: GW59315
2026-03-30 07:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e822b522-174b-5e95-ba59-2c1efadefab0 with identifier: GW59315 to the API
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:14:11Z',
 'fuel_type': 'petrol',
 'id': 'e822b522-174b-5e95-ba59-2c1efadefab0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW59315',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 85838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-30 07:30:40 [auto1.de] INFO: Saving data for GW59315: {'auction_closing_time': 1774970051.0, 'created_time': 1774380207.566477, 'last_price_update_time': 1774855840.073476}
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW59315') HTTP/1.1" 204 0
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV83798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6a1d10>
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg saved to cache
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bebd9e50>
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_a161c96287740b959cd5c0762205db74.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a161c96287740b959cd5c0762205db74.jpg saved to cache
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc578e10>
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_304d1b6e1ce9955818f839fb865ea243.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_304d1b6e1ce9955818f839fb865ea243.jpg saved to cache
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc567e90>
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg saved to cache
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e53193-85fd-584b-9cb1-64b3f76fb501 with identifier: PH37878
2026-03-30 07:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e53193-85fd-584b-9cb1-64b3f76fb501 with scrape type 1
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_89bd0b957404736f23b1fa9a08235e2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_89bd0b957404736f23b1fa9a08235e2f.jpg not downloaded yet
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc69c990>
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_a53c16e1845cc6b9941e0892ab21306c.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_a53c16e1845cc6b9941e0892ab21306c.jpg saved to cache
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_77f2946d76717a76c8689d561baf2480.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:40 [auto1.de] INFO: Found listing with ID: KP40220
2026-03-30 07:30:40 [auto1.de] INFO: Found listing with ID: LE91288
2026-03-30 07:30:40 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ36812%27 HTTP/1.1" 200 None
2026-03-30 07:30:40 [auto1.de] INFO: Scrape type for MZ36812: 2
2026-03-30 07:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with identifier: MZ36812
2026-03-30 07:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with scrape type 2
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with scrape type 2
2026-03-30 07:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e306e7d-b9b9-5432-850e-b3bad3efcea2, identifier: MZ36812
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_220885933f77d4dd714ac337501319a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_220885933f77d4dd714ac337501319a0.jpg not downloaded yet
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_217750ad7b2ce68d76bde728db3f82a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_9058656f141210e0f84dd2482812ffc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with identifier: MZ36812
2026-03-30 07:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with identifier: MZ36812
2026-03-30 07:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e306e7d-b9b9-5432-850e-b3bad3efcea2 with identifier: MZ36812 to the API
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:38:29Z',
 'fuel_type': 'diesel',
 'id': '5e306e7d-b9b9-5432-850e-b3bad3efcea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ36812',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 142835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Ultimate Dark AWD',
 'transmission': 'automatic',
 'trim': 'Ultimate Dark AWD',
 'year': 2022}
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ36812%27 HTTP/1.1" 200 None
2026-03-30 07:30:40 [auto1.de] INFO: Saving data for MZ36812: {'auction_closing_time': 1774971509.0, 'created_time': 1774551892.579683, 'last_price_update_time': 1774855840.966045}
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ36812') HTTP/1.1" 204 0
2026-03-30 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_f22d4444b70fc0392d4a07eca3345b15.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_f22d4444b70fc0392d4a07eca3345b15.jpg not downloaded yet
2026-03-30 07:30:41 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 7186 | hits on page: 40
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc57b010>
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_bc859e20e79b8b28db86995586d37fea.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_bc859e20e79b8b28db86995586d37fea.jpg saved to cache
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:41 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM88493%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [auto1.de] INFO: Scrape type for FM88493: 2
2026-03-30 07:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with identifier: FM88493
2026-03-30 07:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with scrape type 2
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with scrape type 2
2026-03-30 07:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d15ae5f-f50d-544a-b0ca-99be78bbe01a, identifier: FM88493
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_9c7aa89200e8256e9a16aed29471975b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9c7aa89200e8256e9a16aed29471975b.jpg not downloaded yet
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6645d0>
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_836673094494eb693ce533d9e716af54.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_836673094494eb693ce533d9e716af54.jpg saved to cache
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_f0409872ef9b068482fe5672c5f6a777.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with identifier: FM88493
2026-03-30 07:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with identifier: FM88493
2026-03-30 07:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d15ae5f-f50d-544a-b0ca-99be78bbe01a with identifier: FM88493 to the API
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:00Z',
 'fuel_type': 'diesel',
 'id': '9d15ae5f-f50d-544a-b0ca-99be78bbe01a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM88493',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 102977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 d 4Matic Style',
 'transmission': 'automatic',
 'trim': '4Matic Style',
 'year': 2022}
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM88493%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [auto1.de] INFO: Saving data for FM88493: {'auction_closing_time': 1774969980.0, 'created_time': 1774551880.427494, 'last_price_update_time': 1774855841.655188}
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM88493') HTTP/1.1" 204 0
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg not downloaded yet
2026-03-30 07:30:41 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 07:30:41 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD89084%27 HTTP/1.1" 200 None
2026-03-30 07:30:41 [auto1.de] INFO: Scrape type for TD89084: 2
2026-03-30 07:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b633424-201f-5f57-88f5-957ddf789ee2 with identifier: TD89084
2026-03-30 07:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b633424-201f-5f57-88f5-957ddf789ee2 with scrape type 2
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b633424-201f-5f57-88f5-957ddf789ee2 with scrape type 2
2026-03-30 07:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b633424-201f-5f57-88f5-957ddf789ee2, identifier: TD89084
2026-03-30 07:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc69a390>
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7b%252F557b33d7fc328aa87d814528e2661ace%252Fpa%252FNN66793_77f2946d76717a76c8689d561baf2480.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_77f2946d76717a76c8689d561baf2480.jpg saved to cache
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5
2026-03-30 07:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02c3b33d-3a41-5ede-99c8-2b341d231bd5, skipping ID generation
2026-03-30 07:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with scrape type 1
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02c3b33d-3a41-5ede-99c8-2b341d231bd5 sending to next pipeline
2026-03-30 07:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02c3b33d-3a41-5ede-99c8-2b341d231bd5, identifier: NN66793
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6856d0>
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg saved to cache
2026-03-30 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:42 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-30 07:30:42 [auto1.de] INFO: Found listing with ID: XW15114
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW15114%27 HTTP/1.1" 200 None
2026-03-30 07:30:42 [auto1.de] INFO: Scrape type for XW15114: 2
2026-03-30 07:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8217f4c2-9fc6-5795-a23d-0468c2e95132 with identifier: XW15114
2026-03-30 07:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8217f4c2-9fc6-5795-a23d-0468c2e95132 with scrape type 2
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8217f4c2-9fc6-5795-a23d-0468c2e95132 with scrape type 2
2026-03-30 07:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8217f4c2-9fc6-5795-a23d-0468c2e95132, identifier: XW15114
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_46a72d6251056ba45cbc13312b144a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_46a72d6251056ba45cbc13312b144a70.jpg not downloaded yet
2026-03-30 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b633424-201f-5f57-88f5-957ddf789ee2 with identifier: TD89084
2026-03-30 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b633424-201f-5f57-88f5-957ddf789ee2 with identifier: TD89084
2026-03-30 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b633424-201f-5f57-88f5-957ddf789ee2 with identifier: TD89084 to the API
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:17Z',
 'fuel_type': 'diesel',
 'id': '9b633424-201f-5f57-88f5-957ddf789ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD89084',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 24383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2018}
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD89084%27 HTTP/1.1" 200 None
2026-03-30 07:30:42 [auto1.de] INFO: Saving data for TD89084: {'auction_closing_time': 1774970117.0, 'created_time': 1774379318.322954, 'last_price_update_time': 1774855842.492401}
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD89084') HTTP/1.1" 204 0
2026-03-30 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with identifier: NN66793
2026-03-30 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with identifier: NN66793
2026-03-30 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02c3b33d-3a41-5ede-99c8-2b341d231bd5 with identifier: NN66793 to the API
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_77f2946d76717a76c8689d561baf2480.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:49Z',
 'fuel_type': 'petrol',
 'id': '02c3b33d-3a41-5ede-99c8-2b341d231bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN66793',
 'listing': 'auction',
 'location': 'DE, Würzburg',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 129023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_c07106592f7eec37323a94af2cc5b232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_77f2946d76717a76c8689d561baf2480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_4ae74e9d9b134ce97f10d6d1e7083634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_a53c16e1845cc6b9941e0892ab21306c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c3b33d-3a41-5ede-99c8-2b341d231bd5/02c3b33d-3a41-5ede-99c8-2b341d231bd5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7b/557b33d7fc328aa87d814528e2661ace/pa/NN66793_bc859e20e79b8b28db86995586d37fea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2011}
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66793%27 HTTP/1.1" 200 None
2026-03-30 07:30:42 [auto1.de] INFO: Saving data for NN66793: {'created_time': 1774855842.899434, 'last_price_update_time': 1774855842.899445, 'auction_closing_time': 1774972729.0}
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN66793') HTTP/1.1" 204 0
2026-03-30 07:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc697ed0>
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg saved to cache
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b3a10>
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_217750ad7b2ce68d76bde728db3f82a6.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_217750ad7b2ce68d76bde728db3f82a6.jpg saved to cache
2026-03-30 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc786d50>
2026-03-30 07:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_9058656f141210e0f84dd2482812ffc4.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_9058656f141210e0f84dd2482812ffc4.jpg saved to cache
2026-03-30 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_1f8cf013e7050bccdc27af8343a3674e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8217f4c2-9fc6-5795-a23d-0468c2e95132 with identifier: XW15114
2026-03-30 07:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8217f4c2-9fc6-5795-a23d-0468c2e95132 with identifier: XW15114
2026-03-30 07:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8217f4c2-9fc6-5795-a23d-0468c2e95132 with identifier: XW15114 to the API
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:35:02Z',
 'fuel_type': 'petrol',
 'id': '8217f4c2-9fc6-5795-a23d-0468c2e95132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW15114',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 113709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Opel Astra 1.6 SIDI Turbo ON Start/Stop',
 'transmission': 'manual',
 'trim': 'ON Start/Stop',
 'year': 2018}
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW15114%27 HTTP/1.1" 200 None
2026-03-30 07:30:43 [auto1.de] INFO: Saving data for XW15114: {'auction_closing_time': 1774971302.0, 'created_time': 1773660196.510049, 'last_price_update_time': 1774855843.406489}
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW15114') HTTP/1.1" 204 0
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg not downloaded yet
2026-03-30 07:30:43 [auto1.de] INFO: Found listing with ID: NA47397
2026-03-30 07:30:43 [auto1.de] INFO: Found listing with ID: NJ85165
2026-03-30 07:30:43 [auto1.de] INFO: Found listing with ID: MS93141
2026-03-30 07:30:43 [auto1.de] INFO: Found listing with ID: PY91444
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY91444%27 HTTP/1.1" 200 None
2026-03-30 07:30:43 [auto1.de] INFO: Scrape type for PY91444: 2
2026-03-30 07:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e1a748-378e-52e6-bd19-66286db9b45b with identifier: PY91444
2026-03-30 07:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1a748-378e-52e6-bd19-66286db9b45b with scrape type 2
2026-03-30 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97e1a748-378e-52e6-bd19-66286db9b45b with scrape type 2
2026-03-30 07:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97e1a748-378e-52e6-bd19-66286db9b45b, identifier: PY91444
2026-03-30 07:30:43 [auto1.de] INFO: Found listing with ID: TC34492
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC34492%27 HTTP/1.1" 200 None
2026-03-30 07:30:43 [auto1.de] INFO: Scrape type for TC34492: 1
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_4d22379a507057689a854da3b4777354.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_4d22379a507057689a854da3b4777354.jpg not downloaded yet
2026-03-30 07:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97e1a748-378e-52e6-bd19-66286db9b45b with identifier: PY91444
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 07:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97e1a748-378e-52e6-bd19-66286db9b45b with identifier: PY91444
2026-03-30 07:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97e1a748-378e-52e6-bd19-66286db9b45b with identifier: PY91444 to the API
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:39:29Z',
 'fuel_type': 'hybrid',
 'id': '97e1a748-378e-52e6-bd19-66286db9b45b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY91444',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 54440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-13',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2021}
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY91444%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [auto1.de] INFO: Saving data for PY91444: {'auction_closing_time': 1774971569.0, 'created_time': 1774292107.73495, 'last_price_update_time': 1774855844.077161}
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY91444') HTTP/1.1" 204 0
2026-03-30 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ55907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA67051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc69ee90>
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg saved to cache
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc774e50>
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_f0409872ef9b068482fe5672c5f6a777.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_f0409872ef9b068482fe5672c5f6a777.jpg saved to cache
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_89bd0b957404736f23b1fa9a08235e2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_1c85ec43ccf24a414b29348a0733b122.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_1c85ec43ccf24a414b29348a0733b122.jpg not downloaded yet
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: MT16554
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: UJ03238
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: MJ68387
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: ZT52694
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: VG52459
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52459%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [auto1.de] INFO: Scrape type for VG52459: 2
2026-03-30 07:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with identifier: VG52459
2026-03-30 07:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with scrape type 2
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with scrape type 2
2026-03-30 07:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6, identifier: VG52459
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc51ea50>
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg saved to cache
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:44 [auto1.de] INFO: Found listing with ID: CL81037
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL81037%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [auto1.de] INFO: Scrape type for CL81037: 1
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg not downloaded yet
2026-03-30 07:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with identifier: VG52459
2026-03-30 07:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with identifier: VG52459
2026-03-30 07:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6 with identifier: VG52459 to the API
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:09:08Z',
 'fuel_type': 'diesel',
 'id': 'f94dda7f-c6f1-5f2c-ab5e-faa44249d1d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52459',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 119190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52459%27 HTTP/1.1" 200 None
2026-03-30 07:30:44 [auto1.de] INFO: Saving data for VG52459: {'auction_closing_time': 1774969748.0, 'created_time': 1774034417.798257, 'last_price_update_time': 1774855844.855339}
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG52459') HTTP/1.1" 204 0
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc76a650>
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_1f8cf013e7050bccdc27af8343a3674e.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_1f8cf013e7050bccdc27af8343a3674e.jpg saved to cache
2026-03-30 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc814710>
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg saved to cache
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc51ea10>
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg saved to cache
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_f22d4444b70fc0392d4a07eca3345b15.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: HX90718
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX90718%27 HTTP/1.1" 200 None
2026-03-30 07:30:45 [auto1.de] INFO: Scrape type for HX90718: 2
2026-03-30 07:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9797c3c9-0b77-5634-9eee-62516411d7bc with identifier: HX90718
2026-03-30 07:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9797c3c9-0b77-5634-9eee-62516411d7bc with scrape type 2
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9797c3c9-0b77-5634-9eee-62516411d7bc with scrape type 2
2026-03-30 07:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9797c3c9-0b77-5634-9eee-62516411d7bc, identifier: HX90718
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP13096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9c7aa89200e8256e9a16aed29471975b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: FA98768
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD89084%27 HTTP/1.1" 200 None
2026-03-30 07:30:45 [auto1.de] INFO: Scrape type for TD89084: 0
2026-03-30 07:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9797c3c9-0b77-5634-9eee-62516411d7bc with identifier: HX90718
2026-03-30 07:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9797c3c9-0b77-5634-9eee-62516411d7bc with identifier: HX90718
2026-03-30 07:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9797c3c9-0b77-5634-9eee-62516411d7bc with identifier: HX90718 to the API
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:40:06Z',
 'fuel_type': 'petrol',
 'id': '9797c3c9-0b77-5634-9eee-62516411d7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX90718',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 108349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX90718%27 HTTP/1.1" 200 None
2026-03-30 07:30:45 [auto1.de] INFO: Saving data for HX90718: {'auction_closing_time': 1774971606.0, 'created_time': 1773341957.429658, 'last_price_update_time': 1774855845.552469}
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX90718') HTTP/1.1" 204 0
2026-03-30 07:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc959210>
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_89bd0b957404736f23b1fa9a08235e2f.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_89bd0b957404736f23b1fa9a08235e2f.jpg saved to cache
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc75b3d0>
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd1%252F54d1b9a722a6420aef3a9bc4b08ddc24%252Fpa%252FTB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg saved to cache
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f
2026-03-30 07:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 132f3c2c-835d-5d5b-9eb6-781127a1b81f, skipping ID generation
2026-03-30 07:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f with scrape type 1
2026-03-30 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 132f3c2c-835d-5d5b-9eb6-781127a1b81f sending to next pipeline
2026-03-30 07:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 132f3c2c-835d-5d5b-9eb6-781127a1b81f, identifier: TB77328
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_220885933f77d4dd714ac337501319a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:45 [auto1.de] INFO: Found listing with ID: VD66153
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD66153%27 HTTP/1.1" 200 None
2026-03-30 07:30:45 [auto1.de] INFO: Scrape type for VD66153: 1
2026-03-30 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR53160> (referer: https://www.auto1.com/v1/car-details-view/BR53160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 132f3c2c-835d-5d5b-9eb6-781127a1b81f with identifier: TB77328
2026-03-30 07:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 132f3c2c-835d-5d5b-9eb6-781127a1b81f with identifier: TB77328
2026-03-30 07:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 132f3c2c-835d-5d5b-9eb6-781127a1b81f with identifier: TB77328 to the API
2026-03-30 07:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:40:20Z',
 'fuel_type': 'petrol',
 'id': '132f3c2c-835d-5d5b-9eb6-781127a1b81f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB77328',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 146824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_4f62765d29c4bc552f236c6bf64c4de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_3ef3df8cd621ea5ba7cbbe5e09e87dbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_217750ad7b2ce68d76bde728db3f82a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_c0507d8266ef8f7cce74c910add0f5c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132f3c2c-835d-5d5b-9eb6-781127a1b81f/132f3c2c-835d-5d5b-9eb6-781127a1b81f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/d1/54d1b9a722a6420aef3a9bc4b08ddc24/pa/TB77328_b5d1f0c02dce1df7daf83276faf0c01f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77328%27 HTTP/1.1" 200 None
2026-03-30 07:30:46 [auto1.de] INFO: Saving data for TB77328: {'created_time': 1774855846.558939, 'last_price_update_time': 1774855846.558951, 'auction_closing_time': 1774971620.0}
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB77328') HTTP/1.1" 204 0
2026-03-30 07:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc620510>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_203499942de41c11ec5fdeef45b4e188.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_46a72d6251056ba45cbc13312b144a70.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc57bb90>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_f22d4444b70fc0392d4a07eca3345b15.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_f22d4444b70fc0392d4a07eca3345b15.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:46 [auto1.de] INFO: Found listing with ID: ZE47556
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE47556%27 HTTP/1.1" 200 None
2026-03-30 07:30:46 [auto1.de] INFO: Scrape type for ZE47556: 1
2026-03-30 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS70088> (referer: https://www.auto1.com/v1/car-details-view/TS70088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc918790>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc73a350>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_9c7aa89200e8256e9a16aed29471975b.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9c7aa89200e8256e9a16aed29471975b.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_4d22379a507057689a854da3b4777354.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc86c250>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca3fb90>
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_220885933f77d4dd714ac337501319a0.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_220885933f77d4dd714ac337501319a0.jpg saved to cache
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b18625e-a1bf-565d-873a-24dd0e1c508e with identifier: BR53160
2026-03-30 07:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b18625e-a1bf-565d-873a-24dd0e1c508e with scrape type 1
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9b18625e-a1bf-565d-873a-24dd0e1c508e
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1c%252F6b1c9a1d4102161aeda9120b2d2b762c%252Fpa%252FBR53160_7fca306e406f90ae90db2ef8118c41fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_7fca306e406f90ae90db2ef8118c41fa.jpg already downloaded
2026-03-30 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1c%252F6b1c9a1d4102161aeda9120b2d2b762c%252Fpa%252FBR53160_e33baf260f1354d51cde4bdfb07ab283.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_e33baf260f1354d51cde4bdfb07ab283.jpg already downloaded
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1c%252F6b1c9a1d4102161aeda9120b2d2b762c%252Fpa%252FBR53160_f8c9b33f80991747a2949b88557d568b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_f8c9b33f80991747a2949b88557d568b.jpg already downloaded
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1c%252F6b1c9a1d4102161aeda9120b2d2b762c%252Fpa%252FBR53160_d555f57b0667bd4956c26cc1955ea4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_d555f57b0667bd4956c26cc1955ea4df.jpg already downloaded
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1c%252F6b1c9a1d4102161aeda9120b2d2b762c%252Fpa%252FBR53160_29f3bbe8bf06b011befb79fd736e01e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_29f3bbe8bf06b011befb79fd736e01e5.jpg already downloaded
2026-03-30 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b18625e-a1bf-565d-873a-24dd0e1c508e, identifier: BR53160
2026-03-30 07:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_1c85ec43ccf24a414b29348a0733b122.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:47 [auto1.de] INFO: Found listing with ID: UX02896
2026-03-30 07:30:47 [auto1.de] INFO: Found listing with ID: DD06486
2026-03-30 07:30:47 [auto1.de] INFO: Found listing with ID: BF72847
2026-03-30 07:30:47 [auto1.de] INFO: Found listing with ID: GB26940
2026-03-30 07:30:47 [auto1.de] INFO: Found listing with ID: VT33840
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT33840%27 HTTP/1.1" 200 None
2026-03-30 07:30:47 [auto1.de] INFO: Scrape type for VT33840: 2
2026-03-30 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c390a544-a3dd-5570-a85d-4eace68d3ded with identifier: VT33840
2026-03-30 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c390a544-a3dd-5570-a85d-4eace68d3ded with scrape type 2
2026-03-30 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c390a544-a3dd-5570-a85d-4eace68d3ded with scrape type 2
2026-03-30 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c390a544-a3dd-5570-a85d-4eace68d3ded, identifier: VT33840
2026-03-30 07:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b18625e-a1bf-565d-873a-24dd0e1c508e with identifier: BR53160
2026-03-30 07:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b18625e-a1bf-565d-873a-24dd0e1c508e with identifier: BR53160
2026-03-30 07:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b18625e-a1bf-565d-873a-24dd0e1c508e with identifier: BR53160 to the API
2026-03-30 07:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR53160>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'petrol',
 'id': '9b18625e-a1bf-565d-873a-24dd0e1c508e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR53160',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 109332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_7fca306e406f90ae90db2ef8118c41fa.jpg',
                'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_e33baf260f1354d51cde4bdfb07ab283.jpg',
                'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_f8c9b33f80991747a2949b88557d568b.jpg',
                'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_d555f57b0667bd4956c26cc1955ea4df.jpg',
                'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_29f3bbe8bf06b011befb79fd736e01e5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b18625e-a1bf-565d-873a-24dd0e1c508e/9b18625e-a1bf-565d-873a-24dd0e1c508e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_7fca306e406f90ae90db2ef8118c41fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b18625e-a1bf-565d-873a-24dd0e1c508e/9b18625e-a1bf-565d-873a-24dd0e1c508e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_e33baf260f1354d51cde4bdfb07ab283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b18625e-a1bf-565d-873a-24dd0e1c508e/9b18625e-a1bf-565d-873a-24dd0e1c508e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_f8c9b33f80991747a2949b88557d568b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b18625e-a1bf-565d-873a-24dd0e1c508e/9b18625e-a1bf-565d-873a-24dd0e1c508e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_d555f57b0667bd4956c26cc1955ea4df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b18625e-a1bf-565d-873a-24dd0e1c508e/9b18625e-a1bf-565d-873a-24dd0e1c508e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1c/6b1c9a1d4102161aeda9120b2d2b762c/pa/BR53160_29f3bbe8bf06b011befb79fd736e01e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53160%27 HTTP/1.1" 200 None
2026-03-30 07:30:48 [auto1.de] INFO: Saving data for BR53160: {'created_time': 1774855848.715286, 'last_price_update_time': 1774855848.715298, 'auction_closing_time': 1774972683.0}
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR53160') HTTP/1.1" 204 0
2026-03-30 07:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c390a544-a3dd-5570-a85d-4eace68d3ded with identifier: VT33840
2026-03-30 07:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c390a544-a3dd-5570-a85d-4eace68d3ded with identifier: VT33840
2026-03-30 07:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c390a544-a3dd-5570-a85d-4eace68d3ded with identifier: VT33840 to the API
2026-03-30 07:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:51:18Z',
 'fuel_type': 'petrol',
 'id': 'c390a544-a3dd-5570-a85d-4eace68d3ded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT33840',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 93938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-26',
 'seller_name': None,
 'title': 'MINI Coupe Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT33840%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [auto1.de] INFO: Saving data for VT33840: {'auction_closing_time': 1774972278.0, 'created_time': 1774293930.601646, 'last_price_update_time': 1774855849.199156}
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT33840') HTTP/1.1" 204 0
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc664d90>
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_203499942de41c11ec5fdeef45b4e188.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_203499942de41c11ec5fdeef45b4e188.jpg saved to cache
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be859010>
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_46a72d6251056ba45cbc13312b144a70.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_46a72d6251056ba45cbc13312b144a70.jpg saved to cache
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:49 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC65720%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [auto1.de] INFO: Scrape type for GC65720: 2
2026-03-30 07:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with identifier: GC65720
2026-03-30 07:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with scrape type 2
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with scrape type 2
2026-03-30 07:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ad3daa0-41e6-5dc7-8015-caaf663b0393, identifier: GC65720
2026-03-30 07:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e with identifier: TS70088
2026-03-30 07:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e with scrape type 1
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_c06982d46b2dc318b5a7abab0e1c8917.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_c06982d46b2dc318b5a7abab0e1c8917.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_5eea935fc5c71b0bd83bf6fb1aff6f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_5eea935fc5c71b0bd83bf6fb1aff6f61.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_832152b82f4417095233d2659eb93253.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_832152b82f4417095233d2659eb93253.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_9ad67a44e4c0872fd0d081e75625961a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_9ad67a44e4c0872fd0d081e75625961a.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_e1bc5ac6089c875f79ef48978b2e9279.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_e1bc5ac6089c875f79ef48978b2e9279.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_ed4f5ad92be05cde31f3409338003f7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_ed4f5ad92be05cde31f3409338003f7e.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_17c9726a4d6e7815ec761ae5080f22ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_17c9726a4d6e7815ec761ae5080f22ce.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_913ad4020f81c77d3319412948be7d6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_913ad4020f81c77d3319412948be7d6d.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_b4bcfa806e7d0b69e4161177b304996d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_b4bcfa806e7d0b69e4161177b304996d.jpg already downloaded
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F02%252F7002d3c12dd51f97ed7b92356537d5f5%252Fpa%252FTS70088_941a575b4d1e4618656b7e61fcd87719.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_941a575b4d1e4618656b7e61fcd87719.jpg already downloaded
2026-03-30 07:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e, identifier: TS70088
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc80d350>
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_4d22379a507057689a854da3b4777354.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_4d22379a507057689a854da3b4777354.jpg saved to cache
2026-03-30 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:49 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 7190 | hits on page: 40
2026-03-30 07:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with identifier: GC65720
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 07:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with identifier: GC65720
2026-03-30 07:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ad3daa0-41e6-5dc7-8015-caaf663b0393 with identifier: GC65720 to the API
2026-03-30 07:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:23:53Z',
 'fuel_type': 'diesel',
 'id': '6ad3daa0-41e6-5dc7-8015-caaf663b0393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC65720',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 191253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2020}
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC65720%27 HTTP/1.1" 200 None
2026-03-30 07:30:51 [auto1.de] INFO: Saving data for GC65720: {'auction_closing_time': 1774970633.0, 'created_time': 1774377048.975624, 'last_price_update_time': 1774855851.808376}
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC65720') HTTP/1.1" 204 0
2026-03-30 07:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e with identifier: TS70088
2026-03-30 07:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e with identifier: TS70088
2026-03-30 07:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f9f31a6-a19f-5f7b-a598-1a0c23b6894e with identifier: TS70088 to the API
2026-03-30 07:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS70088>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:42Z',
 'fuel_type': 'diesel',
 'id': '7f9f31a6-a19f-5f7b-a598-1a0c23b6894e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS70088',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_c06982d46b2dc318b5a7abab0e1c8917.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_5eea935fc5c71b0bd83bf6fb1aff6f61.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_832152b82f4417095233d2659eb93253.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_9ad67a44e4c0872fd0d081e75625961a.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_e1bc5ac6089c875f79ef48978b2e9279.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_ed4f5ad92be05cde31f3409338003f7e.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_17c9726a4d6e7815ec761ae5080f22ce.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_913ad4020f81c77d3319412948be7d6d.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_b4bcfa806e7d0b69e4161177b304996d.jpg',
                'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_941a575b4d1e4618656b7e61fcd87719.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_c06982d46b2dc318b5a7abab0e1c8917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_5eea935fc5c71b0bd83bf6fb1aff6f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_832152b82f4417095233d2659eb93253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_9ad67a44e4c0872fd0d081e75625961a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_e1bc5ac6089c875f79ef48978b2e9279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_ed4f5ad92be05cde31f3409338003f7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_17c9726a4d6e7815ec761ae5080f22ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_913ad4020f81c77d3319412948be7d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_b4bcfa806e7d0b69e4161177b304996d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f31a6-a19f-5f7b-a598-1a0c23b6894e/7f9f31a6-a19f-5f7b-a598-1a0c23b6894e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/02/7002d3c12dd51f97ed7b92356537d5f5/pa/TS70088_941a575b4d1e4618656b7e61fcd87719.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS70088%27 HTTP/1.1" 200 None
2026-03-30 07:30:53 [auto1.de] INFO: Saving data for TS70088: {'created_time': 1774855853.072976, 'last_price_update_time': 1774855853.072993, 'auction_closing_time': 1774972602.0}
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS70088') HTTP/1.1" 204 0
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8d9f90>
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg saved to cache
2026-03-30 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc993290>
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F8f%252F1a8fd6d12d32301747aacb751c399c0a%252Fpa%252FPH37878_1c85ec43ccf24a414b29348a0733b122.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_1c85ec43ccf24a414b29348a0733b122.jpg saved to cache
2026-03-30 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82e53193-85fd-584b-9cb1-64b3f76fb501
2026-03-30 07:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82e53193-85fd-584b-9cb1-64b3f76fb501, skipping ID generation
2026-03-30 07:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e53193-85fd-584b-9cb1-64b3f76fb501 with scrape type 1
2026-03-30 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82e53193-85fd-584b-9cb1-64b3f76fb501 sending to next pipeline
2026-03-30 07:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82e53193-85fd-584b-9cb1-64b3f76fb501, identifier: PH37878
2026-03-30 07:30:53 [auto1.de] INFO: Found listing with ID: FG52095
2026-03-30 07:30:53 [auto1.de] INFO: Found listing with ID: HR38686
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR38686%27 HTTP/1.1" 200 None
2026-03-30 07:30:53 [auto1.de] INFO: Scrape type for HR38686: 1
2026-03-30 07:30:53 [auto1.de] INFO: Found listing with ID: BZ48067
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ48067%27 HTTP/1.1" 200 None
2026-03-30 07:30:53 [auto1.de] INFO: Scrape type for BZ48067: 1
2026-03-30 07:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82e53193-85fd-584b-9cb1-64b3f76fb501 with identifier: PH37878
2026-03-30 07:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82e53193-85fd-584b-9cb1-64b3f76fb501 with identifier: PH37878
2026-03-30 07:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82e53193-85fd-584b-9cb1-64b3f76fb501 with identifier: PH37878 to the API
2026-03-30 07:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_1c85ec43ccf24a414b29348a0733b122.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 232,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'diesel',
 'id': '82e53193-85fd-584b-9cb1-64b3f76fb501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH37878',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 429008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_89bd0b957404736f23b1fa9a08235e2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_f22d4444b70fc0392d4a07eca3345b15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_b9b1784bac2c63ad2a21f649aeb4f41f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_8b57f164a3341b2a85f9975c1dcc5944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e53193-85fd-584b-9cb1-64b3f76fb501/82e53193-85fd-584b-9cb1-64b3f76fb501_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/8f/1a8fd6d12d32301747aacb751c399c0a/pa/PH37878_1c85ec43ccf24a414b29348a0733b122.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH37878%27 HTTP/1.1" 200 None
2026-03-30 07:30:55 [auto1.de] INFO: Saving data for PH37878: {'created_time': 1774855855.16028, 'last_price_update_time': 1774855855.160293, 'auction_closing_time': 1774971740.0}
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH37878') HTTP/1.1" 204 0
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7c1390>
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg saved to cache
2026-03-30 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV60549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc901a90>
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F45%252Fae452e0be285edb6c928605647ba096c%252Fpa%252FUH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg saved to cache
2026-03-30 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60
2026-03-30 07:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60, skipping ID generation
2026-03-30 07:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with scrape type 1
2026-03-30 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 sending to next pipeline
2026-03-30 07:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60, identifier: UH00780
2026-03-30 07:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_3422d0b89ac6cef7be424432862f41ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: VK11112
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: CX31809
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: XN56575
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN56575%27 HTTP/1.1" 200 None
2026-03-30 07:30:55 [auto1.de] INFO: Scrape type for XN56575: 1
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: LE66161
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-30 07:30:55 [auto1.de] INFO: Found listing with ID: ME76972
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME76972%27 HTTP/1.1" 200 None
2026-03-30 07:30:55 [auto1.de] INFO: Scrape type for ME76972: 1
2026-03-30 07:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL81037/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC34492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with identifier: UH00780
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 07:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with identifier: UH00780
2026-03-30 07:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72c2eb2e-aa23-568a-b1fa-e03c78a54f60 with identifier: UH00780 to the API
2026-03-30 07:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:41:03Z',
 'fuel_type': 'electro',
 'id': '72c2eb2e-aa23-568a-b1fa-e03c78a54f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00780',
 'listing': 'auction',
 'location': 'DE, Wolfsburg',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 59542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a161c96287740b959cd5c0762205db74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_54100aa2b61b3f8486796e5716dc2d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_304d1b6e1ce9955818f839fb865ea243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_836673094494eb693ce533d9e716af54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_95ec90d8e876c0a58ccd6d8473c41a2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_a1d69c94066cb96e4f8bbae57434b2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_e9233afb1b82b8624ec0e9fbdf38de3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_9058656f141210e0f84dd2482812ffc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_203499942de41c11ec5fdeef45b4e188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72c2eb2e-aa23-568a-b1fa-e03c78a54f60/72c2eb2e-aa23-568a-b1fa-e03c78a54f60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/45/ae452e0be285edb6c928605647ba096c/pa/UH00780_1f8cf013e7050bccdc27af8343a3674e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo electric drive 60 kW passion',
 'transmission': 'automatic',
 'trim': 'passion',
 'year': 2017}
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00780%27 HTTP/1.1" 200 None
2026-03-30 07:30:56 [auto1.de] INFO: Saving data for UH00780: {'created_time': 1774855856.357333, 'last_price_update_time': 1774855856.357346, 'auction_closing_time': 1774971663.0}
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH00780') HTTP/1.1" 204 0
2026-03-30 07:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: CX99229
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: UB29489
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: ZW29576
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: PT66900
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: AH96089
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH96089%27 HTTP/1.1" 200 None
2026-03-30 07:30:56 [auto1.de] INFO: Scrape type for AH96089: 2
2026-03-30 07:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4e6f444-a114-54ee-839f-be16fb868d57 with identifier: AH96089
2026-03-30 07:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4e6f444-a114-54ee-839f-be16fb868d57 with scrape type 2
2026-03-30 07:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4e6f444-a114-54ee-839f-be16fb868d57 with scrape type 2
2026-03-30 07:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4e6f444-a114-54ee-839f-be16fb868d57, identifier: AH96089
2026-03-30 07:30:56 [auto1.de] INFO: Found listing with ID: TG05254
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG05254%27 HTTP/1.1" 200 None
2026-03-30 07:30:56 [auto1.de] INFO: Scrape type for TG05254: 2
2026-03-30 07:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with identifier: TG05254
2026-03-30 07:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with scrape type 2
2026-03-30 07:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with scrape type 2
2026-03-30 07:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c, identifier: TG05254
2026-03-30 07:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD25494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4e6f444-a114-54ee-839f-be16fb868d57 with identifier: AH96089
2026-03-30 07:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4e6f444-a114-54ee-839f-be16fb868d57 with identifier: AH96089
2026-03-30 07:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4e6f444-a114-54ee-839f-be16fb868d57 with identifier: AH96089 to the API
2026-03-30 07:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:35:03Z',
 'fuel_type': 'petrol',
 'id': 'c4e6f444-a114-54ee-839f-be16fb868d57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH96089',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 23168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-19',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2025}
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH96089%27 HTTP/1.1" 200 None
2026-03-30 07:30:58 [auto1.de] INFO: Saving data for AH96089: {'auction_closing_time': 1774971303.0, 'created_time': 1774522369.84242, 'last_price_update_time': 1774855858.12297}
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH96089') HTTP/1.1" 204 0
2026-03-30 07:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with identifier: TG05254
2026-03-30 07:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with identifier: TG05254
2026-03-30 07:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c with identifier: TG05254 to the API
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:02:54Z',
 'fuel_type': 'petrol',
 'id': 'eb95bb6d-4a9f-5d77-bed6-baa0ebe8425c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG05254',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 35093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG05254%27 HTTP/1.1" 200 None
2026-03-30 07:30:58 [auto1.de] INFO: Saving data for TG05254: {'auction_closing_time': 1774969374.0, 'created_time': 1773686417.190772, 'last_price_update_time': 1774855858.680555}
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG05254') HTTP/1.1" 204 0
2026-03-30 07:30:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD66153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:30:58 [auto1.de] INFO: Found listing with ID: MM27884
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM27884%27 HTTP/1.1" 200 None
2026-03-30 07:30:58 [auto1.de] INFO: Scrape type for MM27884: 2
2026-03-30 07:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa42bda-b74c-5a62-8099-23340a6b3b31 with identifier: MM27884
2026-03-30 07:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa42bda-b74c-5a62-8099-23340a6b3b31 with scrape type 2
2026-03-30 07:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa42bda-b74c-5a62-8099-23340a6b3b31 with scrape type 2
2026-03-30 07:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fa42bda-b74c-5a62-8099-23340a6b3b31, identifier: MM27884
2026-03-30 07:30:58 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA57202%27 HTTP/1.1" 200 None
2026-03-30 07:30:58 [auto1.de] INFO: Scrape type for JA57202: 2
2026-03-30 07:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ccd433f-3138-58ea-b233-cd9b8d64c716 with identifier: JA57202
2026-03-30 07:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ccd433f-3138-58ea-b233-cd9b8d64c716 with scrape type 2
2026-03-30 07:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ccd433f-3138-58ea-b233-cd9b8d64c716 with scrape type 2
2026-03-30 07:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ccd433f-3138-58ea-b233-cd9b8d64c716, identifier: JA57202
2026-03-30 07:30:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc86ed90>
2026-03-30 07:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_3422d0b89ac6cef7be424432862f41ab.jpg') HTTP/1.1" 204 0
2026-03-30 07:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_3422d0b89ac6cef7be424432862f41ab.jpg saved to cache
2026-03-30 07:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fa42bda-b74c-5a62-8099-23340a6b3b31 with identifier: MM27884
2026-03-30 07:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fa42bda-b74c-5a62-8099-23340a6b3b31 with identifier: MM27884
2026-03-30 07:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fa42bda-b74c-5a62-8099-23340a6b3b31 with identifier: MM27884 to the API
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:22:33Z',
 'fuel_type': 'diesel',
 'id': '2fa42bda-b74c-5a62-8099-23340a6b3b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM27884',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 180182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2016}
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM27884%27 HTTP/1.1" 200 None
2026-03-30 07:30:59 [auto1.de] INFO: Saving data for MM27884: {'auction_closing_time': 1774970553.0, 'created_time': 1773662248.976232, 'last_price_update_time': 1774855859.555061}
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM27884') HTTP/1.1" 204 0
2026-03-30 07:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ccd433f-3138-58ea-b233-cd9b8d64c716 with identifier: JA57202
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 07:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ccd433f-3138-58ea-b233-cd9b8d64c716 with identifier: JA57202
2026-03-30 07:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ccd433f-3138-58ea-b233-cd9b8d64c716 with identifier: JA57202 to the API
2026-03-30 07:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:54:28Z',
 'fuel_type': 'petrol',
 'id': '9ccd433f-3138-58ea-b233-cd9b8d64c716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA57202',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 127490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-12',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2014}
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA57202%27 HTTP/1.1" 200 None
2026-03-30 07:31:01 [auto1.de] INFO: Saving data for JA57202: {'auction_closing_time': 1774972468.0, 'created_time': 1773303176.1372, 'last_price_update_time': 1774855861.312054}
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA57202') HTTP/1.1" 204 0
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: DD72399
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: BZ48067
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: SK58991
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK58991%27 HTTP/1.1" 200 None
2026-03-30 07:31:01 [auto1.de] INFO: Scrape type for SK58991: 2
2026-03-30 07:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d925bf98-6755-5afa-8196-7ee69f8be0ac with identifier: SK58991
2026-03-30 07:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d925bf98-6755-5afa-8196-7ee69f8be0ac with scrape type 2
2026-03-30 07:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d925bf98-6755-5afa-8196-7ee69f8be0ac with scrape type 2
2026-03-30 07:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d925bf98-6755-5afa-8196-7ee69f8be0ac, identifier: SK58991
2026-03-30 07:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV83798> (referer: https://www.auto1.com/v1/car-details-view/XV83798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ55907> (referer: https://www.auto1.com/v1/car-details-view/LZ55907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d925bf98-6755-5afa-8196-7ee69f8be0ac with identifier: SK58991
2026-03-30 07:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d925bf98-6755-5afa-8196-7ee69f8be0ac with identifier: SK58991
2026-03-30 07:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d925bf98-6755-5afa-8196-7ee69f8be0ac with identifier: SK58991 to the API
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:25:00Z',
 'fuel_type': 'petrol',
 'id': 'd925bf98-6755-5afa-8196-7ee69f8be0ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK58991',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 90408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2021}
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK58991%27 HTTP/1.1" 200 None
2026-03-30 07:31:01 [auto1.de] INFO: Saving data for SK58991: {'auction_closing_time': 1774970700.0, 'created_time': 1773776200.935395, 'last_price_update_time': 1774855861.899811}
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK58991') HTTP/1.1" 204 0
2026-03-30 07:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: LE66161
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: ME76972
2026-03-30 07:31:01 [auto1.de] INFO: Found listing with ID: XZ11049
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ11049%27 HTTP/1.1" 200 None
2026-03-30 07:31:01 [auto1.de] INFO: Scrape type for XZ11049: 2
2026-03-30 07:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78369ccf-883d-54b3-8ec1-2d249082f071 with identifier: XZ11049
2026-03-30 07:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78369ccf-883d-54b3-8ec1-2d249082f071 with scrape type 2
2026-03-30 07:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78369ccf-883d-54b3-8ec1-2d249082f071 with scrape type 2
2026-03-30 07:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78369ccf-883d-54b3-8ec1-2d249082f071, identifier: XZ11049
2026-03-30 07:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA67051> (referer: https://www.auto1.com/v1/car-details-view/EA67051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78369ccf-883d-54b3-8ec1-2d249082f071 with identifier: XZ11049
2026-03-30 07:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78369ccf-883d-54b3-8ec1-2d249082f071 with identifier: XZ11049
2026-03-30 07:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78369ccf-883d-54b3-8ec1-2d249082f071 with identifier: XZ11049 to the API
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:46:45Z',
 'fuel_type': 'petrol',
 'id': '78369ccf-883d-54b3-8ec1-2d249082f071',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ11049',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 146604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-16',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ11049%27 HTTP/1.1" 200 None
2026-03-30 07:31:02 [auto1.de] INFO: Saving data for XZ11049: {'auction_closing_time': 1774972005.0, 'created_time': 1773467680.026395, 'last_price_update_time': 1774855862.533288}
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ11049') HTTP/1.1" 204 0
2026-03-30 07:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:02 [auto1.de] INFO: Found listing with ID: NF89910
2026-03-30 07:31:02 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE38357%27 HTTP/1.1" 200 None
2026-03-30 07:31:02 [auto1.de] INFO: Scrape type for FE38357: 2
2026-03-30 07:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c6bdc6-3e9d-5acc-8993-82808543ad06 with identifier: FE38357
2026-03-30 07:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c6bdc6-3e9d-5acc-8993-82808543ad06 with scrape type 2
2026-03-30 07:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6c6bdc6-3e9d-5acc-8993-82808543ad06 with scrape type 2
2026-03-30 07:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c6bdc6-3e9d-5acc-8993-82808543ad06, identifier: FE38357
2026-03-30 07:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c6bdc6-3e9d-5acc-8993-82808543ad06 with identifier: FE38357
2026-03-30 07:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c6bdc6-3e9d-5acc-8993-82808543ad06 with identifier: FE38357
2026-03-30 07:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c6bdc6-3e9d-5acc-8993-82808543ad06 with identifier: FE38357 to the API
2026-03-30 07:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:11:52Z',
 'fuel_type': 'diesel',
 'id': 'a6c6bdc6-3e9d-5acc-8993-82808543ad06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE38357',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 168796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-21',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE38357%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [auto1.de] INFO: Saving data for FE38357: {'auction_closing_time': 1774969912.0, 'created_time': 1774552512.940777, 'last_price_update_time': 1774855863.134083}
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE38357') HTTP/1.1" 204 0
2026-03-30 07:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa5302d-eb86-52c8-9444-f02387afe39e with identifier: XV83798
2026-03-30 07:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa5302d-eb86-52c8-9444-f02387afe39e with scrape type 1
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_71ab669e06ff9516418094d11856be56.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_71ab669e06ff9516418094d11856be56.jpg not downloaded yet
2026-03-30 07:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75901884-51d6-58a5-9a15-c69fdbfca97f with identifier: LZ55907
2026-03-30 07:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75901884-51d6-58a5-9a15-c69fdbfca97f with scrape type 1
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg not downloaded yet
2026-03-30 07:31:03 [auto1.de] INFO: Found listing with ID: ZX71728
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX71728%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [auto1.de] INFO: Scrape type for ZX71728: 1
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg not downloaded yet
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg not downloaded yet
2026-03-30 07:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f84e7d-6a07-54be-b2cd-78aaee9b79e9 with identifier: EA67051
2026-03-30 07:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f84e7d-6a07-54be-b2cd-78aaee9b79e9 with scrape type 1
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 81f84e7d-6a07-54be-b2cd-78aaee9b79e9
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F16%252F381628be7f22978df87cd38777fdadb2%252Fpa%252FEA67051_d000af004b45c8c1e7adaded9b7c16bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d000af004b45c8c1e7adaded9b7c16bb.jpg already downloaded
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F16%252F381628be7f22978df87cd38777fdadb2%252Fpa%252FEA67051_d60a756b99b19506be9e1e9b6897f714.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d60a756b99b19506be9e1e9b6897f714.jpg already downloaded
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F16%252F381628be7f22978df87cd38777fdadb2%252Fpa%252FEA67051_eb4d9850af2d6c3489c0cbb92a06d2b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_eb4d9850af2d6c3489c0cbb92a06d2b9.jpg already downloaded
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F16%252F381628be7f22978df87cd38777fdadb2%252Fpa%252FEA67051_5c5dab0f2725d42017ab8d933549b8f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_5c5dab0f2725d42017ab8d933549b8f4.jpg already downloaded
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F16%252F381628be7f22978df87cd38777fdadb2%252Fpa%252FEA67051_3d919e17bcb10853e164ed871f3e065d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_3d919e17bcb10853e164ed871f3e065d.jpg already downloaded
2026-03-30 07:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f84e7d-6a07-54be-b2cd-78aaee9b79e9, identifier: EA67051
2026-03-30 07:31:03 [auto1.de] INFO: Found listing with ID: ZM89162
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM89162%27 HTTP/1.1" 200 None
2026-03-30 07:31:03 [auto1.de] INFO: Scrape type for ZM89162: 1
2026-03-30 07:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f84e7d-6a07-54be-b2cd-78aaee9b79e9 with identifier: EA67051
2026-03-30 07:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f84e7d-6a07-54be-b2cd-78aaee9b79e9 with identifier: EA67051
2026-03-30 07:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f84e7d-6a07-54be-b2cd-78aaee9b79e9 with identifier: EA67051 to the API
2026-03-30 07:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA67051>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:21:54Z',
 'fuel_type': 'petrol',
 'id': '81f84e7d-6a07-54be-b2cd-78aaee9b79e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA67051',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 183172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d000af004b45c8c1e7adaded9b7c16bb.jpg',
                'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d60a756b99b19506be9e1e9b6897f714.jpg',
                'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_eb4d9850af2d6c3489c0cbb92a06d2b9.jpg',
                'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_5c5dab0f2725d42017ab8d933549b8f4.jpg',
                'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_3d919e17bcb10853e164ed871f3e065d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84e7d-6a07-54be-b2cd-78aaee9b79e9/81f84e7d-6a07-54be-b2cd-78aaee9b79e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d000af004b45c8c1e7adaded9b7c16bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84e7d-6a07-54be-b2cd-78aaee9b79e9/81f84e7d-6a07-54be-b2cd-78aaee9b79e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_d60a756b99b19506be9e1e9b6897f714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84e7d-6a07-54be-b2cd-78aaee9b79e9/81f84e7d-6a07-54be-b2cd-78aaee9b79e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_eb4d9850af2d6c3489c0cbb92a06d2b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84e7d-6a07-54be-b2cd-78aaee9b79e9/81f84e7d-6a07-54be-b2cd-78aaee9b79e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_5c5dab0f2725d42017ab8d933549b8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84e7d-6a07-54be-b2cd-78aaee9b79e9/81f84e7d-6a07-54be-b2cd-78aaee9b79e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/16/381628be7f22978df87cd38777fdadb2/pa/EA67051_3d919e17bcb10853e164ed871f3e065d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67051%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [auto1.de] INFO: Saving data for EA67051: {'created_time': 1774855864.605415, 'last_price_update_time': 1774855864.605435, 'auction_closing_time': 1774970514.0}
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA67051') HTTP/1.1" 204 0
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_0c24a502f50906c136cb85ba906e5515.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_0c24a502f50906c136cb85ba906e5515.jpg not downloaded yet
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg not downloaded yet
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: DW65340
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: MU67757
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: PC88628
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC88628%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [auto1.de] INFO: Scrape type for PC88628: 1
2026-03-30 07:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP13096> (referer: https://www.auto1.com/v1/car-details-view/XP13096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg not downloaded yet
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg not downloaded yet
2026-03-30 07:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ48067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: KL56138
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: GD26673
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26673%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [auto1.de] INFO: Scrape type for GD26673: 1
2026-03-30 07:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_197790e78c95084fd7e6c4d74e59eae7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_197790e78c95084fd7e6c4d74e59eae7.jpg not downloaded yet
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_27d5c7006f4281f04644136ca7805daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_27d5c7006f4281f04644136ca7805daa.jpg not downloaded yet
2026-03-30 07:31:04 [auto1.de] INFO: Found listing with ID: HT75427
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT75427%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [auto1.de] INFO: Scrape type for HT75427: 1
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_83069744caa99b952f566cbc4aca2e32.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_83069744caa99b952f566cbc4aca2e32.jpg not downloaded yet
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg not downloaded yet
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: YK11401
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: FH85509
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH85509%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [auto1.de] INFO: Scrape type for FH85509: 2
2026-03-30 07:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with identifier: FH85509
2026-03-30 07:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with scrape type 2
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with scrape type 2
2026-03-30 07:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ba58fed-ac5c-5042-9f80-72a6c6774ec1, identifier: FH85509
2026-03-30 07:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e34e37-094e-5bff-82a8-927e5b445eb2 with identifier: XP13096
2026-03-30 07:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e34e37-094e-5bff-82a8-927e5b445eb2 with scrape type 1
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg not downloaded yet
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with identifier: FH85509
2026-03-30 07:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with identifier: FH85509
2026-03-30 07:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ba58fed-ac5c-5042-9f80-72a6c6774ec1 with identifier: FH85509 to the API
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:10:58Z',
 'fuel_type': 'petrol',
 'id': '0ba58fed-ac5c-5042-9f80-72a6c6774ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH85509',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 102784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH85509%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [auto1.de] INFO: Saving data for FH85509: {'auction_closing_time': 1774969858.0, 'created_time': 1773306617.327902, 'last_price_update_time': 1774855865.652855}
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH85509') HTTP/1.1" 204 0
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg not downloaded yet
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: GT95887
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95887%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [auto1.de] INFO: Scrape type for GT95887: 1
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg not downloaded yet
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg not downloaded yet
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: RY03254
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: HC65117
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: EK94658
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: ED11962
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: VN83925
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN83925%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [auto1.de] INFO: Scrape type for VN83925: 1
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg not downloaded yet
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE47556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR38686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN56575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc89ee50>
2026-03-30 07:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg saved to cache
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_312a267b2465ac2f80d9fbae0485c049.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_312a267b2465ac2f80d9fbae0485c049.jpg not downloaded yet
2026-03-30 07:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: XT16299
2026-03-30 07:31:05 [auto1.de] INFO: Found listing with ID: UP75905
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP75905%27 HTTP/1.1" 200 None
2026-03-30 07:31:05 [auto1.de] INFO: Scrape type for UP75905: 2
2026-03-30 07:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5324b1f-415f-561c-8f7e-5e84da88c338 with identifier: UP75905
2026-03-30 07:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5324b1f-415f-561c-8f7e-5e84da88c338 with scrape type 2
2026-03-30 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5324b1f-415f-561c-8f7e-5e84da88c338 with scrape type 2
2026-03-30 07:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5324b1f-415f-561c-8f7e-5e84da88c338, identifier: UP75905
2026-03-30 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_a02344de450ee917fbf7a0978d06093d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a02344de450ee917fbf7a0978d06093d.jpg not downloaded yet
2026-03-30 07:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5324b1f-415f-561c-8f7e-5e84da88c338 with identifier: UP75905
2026-03-30 07:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5324b1f-415f-561c-8f7e-5e84da88c338 with identifier: UP75905
2026-03-30 07:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5324b1f-415f-561c-8f7e-5e84da88c338 with identifier: UP75905 to the API
2026-03-30 07:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:25Z',
 'fuel_type': 'diesel',
 'id': 'a5324b1f-415f-561c-8f7e-5e84da88c338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP75905',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 64255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline FWD',
 'transmission': 'automatic',
 'trim': 'Comfortline FWD',
 'year': 2020}
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP75905%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [auto1.de] INFO: Saving data for UP75905: {'auction_closing_time': 1774969465.0, 'created_time': 1773657512.458264, 'last_price_update_time': 1774855867.629192}
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP75905') HTTP/1.1" 204 0
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg not downloaded yet
2026-03-30 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:07 [auto1.de] INFO: Found listing with ID: BK26573
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK26573%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [auto1.de] INFO: Scrape type for BK26573: 1
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_95c40603e859aca255f92a42a545dfa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_95c40603e859aca255f92a42a545dfa6.jpg not downloaded yet
2026-03-30 07:31:07 [scrapy.extensions.logstats] INFO: Crawled 48 pages (at 48 pages/min), scraped 43 items (at 43 items/min)
2026-03-30 07:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 07:31:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 07:31:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 07:31:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 07:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc71b850>
2026-03-30 07:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg saved to cache
2026-03-30 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:31:07 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 7201 | hits on page: 40
2026-03-30 07:31:07 [auto1.de] INFO: Found listing with ID: MY33164
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY33164%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [auto1.de] INFO: Scrape type for MY33164: 1
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg not downloaded yet
2026-03-30 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_86fe1fa353a82e3b2221120618a6e036.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:07 [auto1.de] INFO: Found listing with ID: BK26573
2026-03-30 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: VF16052
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF16052%27 HTTP/1.1" 200 None
2026-03-30 07:31:08 [auto1.de] INFO: Scrape type for VF16052: 1
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca45590>
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg saved to cache
2026-03-30 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: MY33164
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: XX48334
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: DB70642
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB70642%27 HTTP/1.1" 200 None
2026-03-30 07:31:08 [auto1.de] INFO: Scrape type for DB70642: 1
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: VF16052
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: BR21145
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR21145%27 HTTP/1.1" 200 None
2026-03-30 07:31:08 [auto1.de] INFO: Scrape type for BR21145: 1
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: XX48334
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: DB70642
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG30770%27 HTTP/1.1" 200 None
2026-03-30 07:31:08 [auto1.de] INFO: Scrape type for EG30770: 1
2026-03-30 07:31:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 07:31:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 07:31:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71becf9ed0>
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F96%252F49969aeca38682d4adfb355f2d7edf26%252Fpa%252FNH44567_86fe1fa353a82e3b2221120618a6e036.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_86fe1fa353a82e3b2221120618a6e036.jpg saved to cache
2026-03-30 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25618685-782d-5e10-b526-94687edf0e1f
2026-03-30 07:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25618685-782d-5e10-b526-94687edf0e1f, skipping ID generation
2026-03-30 07:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25618685-782d-5e10-b526-94687edf0e1f with scrape type 1
2026-03-30 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25618685-782d-5e10-b526-94687edf0e1f sending to next pipeline
2026-03-30 07:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25618685-782d-5e10-b526-94687edf0e1f, identifier: NH44567
2026-03-30 07:31:08 [auto1.de] INFO: Found listing with ID: BR21145
2026-03-30 07:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25618685-782d-5e10-b526-94687edf0e1f with identifier: NH44567
2026-03-30 07:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25618685-782d-5e10-b526-94687edf0e1f with identifier: NH44567
2026-03-30 07:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25618685-782d-5e10-b526-94687edf0e1f with identifier: NH44567 to the API
2026-03-30 07:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_86fe1fa353a82e3b2221120618a6e036.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 341,
 'expiration_date': '2026-03-31T15:41:38Z',
 'fuel_type': 'hybrid',
 'id': '25618685-782d-5e10-b526-94687edf0e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH44567',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 258022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4159724,
             'Height': 3744,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_4c9d9795fbe3fa338f775de67f0daba6.jpg',
             'Width': 4992},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_62414e964578e35afb9b858fc5b79fc7.jpg',
             'Width': 618},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_572070098add9f53d1013b95491bd412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_23022fa0bfd5ac73a87dea88729b8bd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_cb1971ac894a6397f1248fd828a2bc3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_489d8700dd13bdacfa7f6d1855919a86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_ac2beb13b6a45d17e9e21598e07212dc.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4070763,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_86fe1fa353a82e3b2221120618a6e036.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_b92ff38681dd3e6e39fe525bd246bc4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25618685-782d-5e10-b526-94687edf0e1f/25618685-782d-5e10-b526-94687edf0e1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/96/49969aeca38682d4adfb355f2d7edf26/pa/NH44567_3422d0b89ac6cef7be424432862f41ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH44567%27 HTTP/1.1" 200 None
2026-03-30 07:31:09 [auto1.de] INFO: Saving data for NH44567: {'created_time': 1774855869.331911, 'last_price_update_time': 1774855869.331923, 'auction_closing_time': 1774971698.0}
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH44567') HTTP/1.1" 204 0
2026-03-30 07:31:09 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51252%27 HTTP/1.1" 200 None
2026-03-30 07:31:09 [auto1.de] INFO: Scrape type for SK51252: 2
2026-03-30 07:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0dee63f-557e-5126-98e2-2f49c3ef0159 with identifier: SK51252
2026-03-30 07:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0dee63f-557e-5126-98e2-2f49c3ef0159 with scrape type 2
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0dee63f-557e-5126-98e2-2f49c3ef0159 with scrape type 2
2026-03-30 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0dee63f-557e-5126-98e2-2f49c3ef0159, identifier: SK51252
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6908d0>
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg saved to cache
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc54d550>
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg saved to cache
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4c42d0>
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg saved to cache
2026-03-30 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0dee63f-557e-5126-98e2-2f49c3ef0159 with identifier: SK51252
2026-03-30 07:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0dee63f-557e-5126-98e2-2f49c3ef0159 with identifier: SK51252
2026-03-30 07:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0dee63f-557e-5126-98e2-2f49c3ef0159 with identifier: SK51252 to the API
2026-03-30 07:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:56:41Z',
 'fuel_type': 'petrol',
 'id': 'e0dee63f-557e-5126-98e2-2f49c3ef0159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK51252',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 238710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51252%27 HTTP/1.1" 200 None
2026-03-30 07:31:10 [auto1.de] INFO: Saving data for SK51252: {'auction_closing_time': 1774972601.0, 'created_time': 1773687113.250265, 'last_price_update_time': 1774855870.704091}
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK51252') HTTP/1.1" 204 0
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME76972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV60549> (referer: https://www.auto1.com/v1/car-details-view/EV60549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC88628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC34492> (referer: https://www.auto1.com/v1/car-details-view/TC34492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL81037> (referer: https://www.auto1.com/v1/car-details-view/CL81037/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD66153> (referer: https://www.auto1.com/v1/car-details-view/VD66153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD25494> (referer: https://www.auto1.com/v1/car-details-view/CD25494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51252%27 HTTP/1.1" 200 None
2026-03-30 07:31:10 [auto1.de] INFO: Scrape type for SK51252: 0
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: GH55253
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: RF59698
2026-03-30 07:31:10 [auto1.de] INFO: Found listing with ID: XW26615
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW26615%27 HTTP/1.1" 200 None
2026-03-30 07:31:10 [auto1.de] INFO: Scrape type for XW26615: 2
2026-03-30 07:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506450d5-550f-58f9-ba3a-a0b93837e890 with identifier: XW26615
2026-03-30 07:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506450d5-550f-58f9-ba3a-a0b93837e890 with scrape type 2
2026-03-30 07:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 506450d5-550f-58f9-ba3a-a0b93837e890 with scrape type 2
2026-03-30 07:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 506450d5-550f-58f9-ba3a-a0b93837e890, identifier: XW26615
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 506450d5-550f-58f9-ba3a-a0b93837e890 with identifier: XW26615
2026-03-30 07:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 506450d5-550f-58f9-ba3a-a0b93837e890 with identifier: XW26615
2026-03-30 07:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 506450d5-550f-58f9-ba3a-a0b93837e890 with identifier: XW26615 to the API
2026-03-30 07:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:24:30Z',
 'fuel_type': 'petrol',
 'id': '506450d5-550f-58f9-ba3a-a0b93837e890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW26615',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 137127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-19',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW26615%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [auto1.de] INFO: Saving data for XW26615: {'auction_closing_time': 1774970670.0, 'created_time': 1774118818.623406, 'last_price_update_time': 1774855871.356602}
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW26615') HTTP/1.1" 204 0
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc686c90>
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg saved to cache
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be827010>
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg saved to cache
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:31:11 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-30 07:31:11 [auto1.de] INFO: Found listing with ID: JB45196
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB45196%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [auto1.de] INFO: Scrape type for JB45196: 1
2026-03-30 07:31:11 [auto1.de] INFO: Found listing with ID: CW07169
2026-03-30 07:31:11 [auto1.de] INFO: Found listing with ID: CS17567
2026-03-30 07:31:11 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36951%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [auto1.de] INFO: Scrape type for LY36951: 2
2026-03-30 07:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63575057-6b6d-5eb5-8bb5-16627f23408b with identifier: LY36951
2026-03-30 07:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63575057-6b6d-5eb5-8bb5-16627f23408b with scrape type 2
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63575057-6b6d-5eb5-8bb5-16627f23408b with scrape type 2
2026-03-30 07:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63575057-6b6d-5eb5-8bb5-16627f23408b, identifier: LY36951
2026-03-30 07:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748721de-e4fd-5e25-adf8-75fe02ebff7c with identifier: EV60549
2026-03-30 07:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748721de-e4fd-5e25-adf8-75fe02ebff7c with scrape type 1
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 748721de-e4fd-5e25-adf8-75fe02ebff7c
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_282e4593bed41edd6146b87323218cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_282e4593bed41edd6146b87323218cc8.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_b4dfd1fcf0d3d3dae0639367c3a99f45.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_b4dfd1fcf0d3d3dae0639367c3a99f45.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_d5376c493aee98bede4ee8eb2aadcf4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_d5376c493aee98bede4ee8eb2aadcf4e.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_c426237d38fa61d24022ac8647703c6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_c426237d38fa61d24022ac8647703c6b.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_dbefd893ca55976f24043f2bf12438d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_dbefd893ca55976f24043f2bf12438d5.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_9cd097410d4d162e5f6367b67afb030e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_9cd097410d4d162e5f6367b67afb030e.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_3fa9519b1e1a613b12d3baefdcc76d99.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_3fa9519b1e1a613b12d3baefdcc76d99.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_f1e0ed43cfef1baad697a23da1bd8193.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_f1e0ed43cfef1baad697a23da1bd8193.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_745aefe5f07f8b4766be8b855614707c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_745aefe5f07f8b4766be8b855614707c.jpg already downloaded
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F10%252Fa4106359ada2f868a4f603979fdb12f2%252Fpa%252FEV60549_ec2052e85ace5085956ef35a4a0040f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_ec2052e85ace5085956ef35a4a0040f1.jpg already downloaded
2026-03-30 07:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 748721de-e4fd-5e25-adf8-75fe02ebff7c, identifier: EV60549
2026-03-30 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd89330a-0bfa-56dd-a3d7-17008f2814b5 with identifier: TC34492
2026-03-30 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd89330a-0bfa-56dd-a3d7-17008f2814b5 with scrape type 1
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg not downloaded yet
2026-03-30 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with identifier: CL81037
2026-03-30 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with scrape type 1
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg not downloaded yet
2026-03-30 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b085219-b80f-5968-9b84-eacefe134677 with identifier: VD66153
2026-03-30 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b085219-b80f-5968-9b84-eacefe134677 with scrape type 1
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_9338e06613b0037c81c9df0e11e8553d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_9338e06613b0037c81c9df0e11e8553d.jpg not downloaded yet
2026-03-30 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with identifier: CD25494
2026-03-30 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with scrape type 1
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_8359b5f1f160993d08ba6c76a0b26431.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8359b5f1f160993d08ba6c76a0b26431.jpg not downloaded yet
2026-03-30 07:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63575057-6b6d-5eb5-8bb5-16627f23408b with identifier: LY36951
2026-03-30 07:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63575057-6b6d-5eb5-8bb5-16627f23408b with identifier: LY36951
2026-03-30 07:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63575057-6b6d-5eb5-8bb5-16627f23408b with identifier: LY36951 to the API
2026-03-30 07:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:56:11Z',
 'fuel_type': 'diesel',
 'id': '63575057-6b6d-5eb5-8bb5-16627f23408b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY36951',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 94419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-20',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 SD V6 R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2019}
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36951%27 HTTP/1.1" 200 None
2026-03-30 07:31:13 [auto1.de] INFO: Saving data for LY36951: {'auction_closing_time': 1774972571.0, 'created_time': 1774378014.016243, 'last_price_update_time': 1774855873.773807}
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY36951') HTTP/1.1" 204 0
2026-03-30 07:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 748721de-e4fd-5e25-adf8-75fe02ebff7c with identifier: EV60549
2026-03-30 07:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 748721de-e4fd-5e25-adf8-75fe02ebff7c with identifier: EV60549
2026-03-30 07:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 748721de-e4fd-5e25-adf8-75fe02ebff7c with identifier: EV60549 to the API
2026-03-30 07:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EV60549>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:25:57Z',
 'fuel_type': 'petrol',
 'id': '748721de-e4fd-5e25-adf8-75fe02ebff7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV60549',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 213166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_282e4593bed41edd6146b87323218cc8.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_b4dfd1fcf0d3d3dae0639367c3a99f45.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_d5376c493aee98bede4ee8eb2aadcf4e.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_c426237d38fa61d24022ac8647703c6b.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_dbefd893ca55976f24043f2bf12438d5.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_9cd097410d4d162e5f6367b67afb030e.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_3fa9519b1e1a613b12d3baefdcc76d99.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_f1e0ed43cfef1baad697a23da1bd8193.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_745aefe5f07f8b4766be8b855614707c.jpg',
                'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_ec2052e85ace5085956ef35a4a0040f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_282e4593bed41edd6146b87323218cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_b4dfd1fcf0d3d3dae0639367c3a99f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_d5376c493aee98bede4ee8eb2aadcf4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_c426237d38fa61d24022ac8647703c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_dbefd893ca55976f24043f2bf12438d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_9cd097410d4d162e5f6367b67afb030e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_3fa9519b1e1a613b12d3baefdcc76d99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_f1e0ed43cfef1baad697a23da1bd8193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_745aefe5f07f8b4766be8b855614707c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_748721de-e4fd-5e25-adf8-75fe02ebff7c/748721de-e4fd-5e25-adf8-75fe02ebff7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/10/a4106359ada2f868a4f603979fdb12f2/pa/EV60549_ec2052e85ace5085956ef35a4a0040f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV60549%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [auto1.de] INFO: Saving data for EV60549: {'created_time': 1774855874.274505, 'last_price_update_time': 1774855874.274521, 'auction_closing_time': 1774970757.0}
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV60549') HTTP/1.1" 204 0
2026-03-30 07:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a02344de450ee917fbf7a0978d06093d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:14 [auto1.de] INFO: Found listing with ID: CX43876
2026-03-30 07:31:14 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30776%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [auto1.de] INFO: Scrape type for UX30776: 2
2026-03-30 07:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with identifier: UX30776
2026-03-30 07:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with scrape type 2
2026-03-30 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with scrape type 2
2026-03-30 07:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2, identifier: UX30776
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_826628e5ab932a1b34c63160ca301a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_826628e5ab932a1b34c63160ca301a3e.jpg not downloaded yet
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg not downloaded yet
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_7b2834216158a13c5689d23f9b7cafa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7b2834216158a13c5689d23f9b7cafa8.jpg not downloaded yet
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_b36ba752e1470f11df997f6d887d81c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_b36ba752e1470f11df997f6d887d81c8.jpg not downloaded yet
2026-03-30 07:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_95c40603e859aca255f92a42a545dfa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with identifier: UX30776
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 07:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with identifier: UX30776
2026-03-30 07:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aeb37c0-84ae-52d8-a6b7-1eb429e239a2 with identifier: UX30776 to the API
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:36:15Z',
 'fuel_type': 'petrol',
 'id': '2aeb37c0-84ae-52d8-a6b7-1eb429e239a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX30776',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 126760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 L Classic',
 'transmission': 'manual',
 'trim': 'L Classic',
 'year': 2003}
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30776%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [auto1.de] INFO: Saving data for UX30776: {'auction_closing_time': 1774971375.0, 'created_time': 1774550643.209437, 'last_price_update_time': 1774855875.062376}
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX30776') HTTP/1.1" 204 0
2026-03-30 07:31:15 [auto1.de] INFO: Found listing with ID: SP41930
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41930%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [auto1.de] INFO: Scrape type for SP41930: 2
2026-03-30 07:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19be901f-2dea-5f67-895e-5efda647931c with identifier: SP41930
2026-03-30 07:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19be901f-2dea-5f67-895e-5efda647931c with scrape type 2
2026-03-30 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19be901f-2dea-5f67-895e-5efda647931c with scrape type 2
2026-03-30 07:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19be901f-2dea-5f67-895e-5efda647931c, identifier: SP41930
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg not downloaded yet
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg not downloaded yet
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg not downloaded yet
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_5a61468fa9c824c85855b43327e8e88e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_5a61468fa9c824c85855b43327e8e88e.jpg not downloaded yet
2026-03-30 07:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19be901f-2dea-5f67-895e-5efda647931c with identifier: SP41930
2026-03-30 07:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19be901f-2dea-5f67-895e-5efda647931c with identifier: SP41930
2026-03-30 07:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19be901f-2dea-5f67-895e-5efda647931c with identifier: SP41930 to the API
2026-03-30 07:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '19be901f-2dea-5f67-895e-5efda647931c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41930',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 130492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41930%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [auto1.de] INFO: Saving data for SP41930: {'auction_closing_time': 1774972041.0, 'created_time': 1773305894.400286, 'last_price_update_time': 1774855876.634193}
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP41930') HTTP/1.1" 204 0
2026-03-30 07:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_259bb88dee568a506636670a33d2d89b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8359b5f1f160993d08ba6c76a0b26431.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:16 [auto1.de] INFO: Found listing with ID: MF04152
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF04152%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [auto1.de] INFO: Scrape type for MF04152: 2
2026-03-30 07:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4ff73b-516b-5ed3-8218-6de2a8edd75e with identifier: MF04152
2026-03-30 07:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4ff73b-516b-5ed3-8218-6de2a8edd75e with scrape type 2
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec4ff73b-516b-5ed3-8218-6de2a8edd75e with scrape type 2
2026-03-30 07:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec4ff73b-516b-5ed3-8218-6de2a8edd75e, identifier: MF04152
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_ea343fc93eb22b6b1d939aa012892d61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_ea343fc93eb22b6b1d939aa012892d61.jpg not downloaded yet
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3e530bc68c434de7f41da33482285112.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3e530bc68c434de7f41da33482285112.jpg not downloaded yet
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg not downloaded yet
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg not downloaded yet
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7d6a90>
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_a02344de450ee917fbf7a0978d06093d.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a02344de450ee917fbf7a0978d06093d.jpg saved to cache
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc627390>
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_95c40603e859aca255f92a42a545dfa6.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_95c40603e859aca255f92a42a545dfa6.jpg saved to cache
2026-03-30 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec4ff73b-516b-5ed3-8218-6de2a8edd75e with identifier: MF04152
2026-03-30 07:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec4ff73b-516b-5ed3-8218-6de2a8edd75e with identifier: MF04152
2026-03-30 07:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec4ff73b-516b-5ed3-8218-6de2a8edd75e with identifier: MF04152 to the API
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:55:06Z',
 'fuel_type': 'petrol',
 'id': 'ec4ff73b-516b-5ed3-8218-6de2a8edd75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF04152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 82963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2018}
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF04152%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [auto1.de] INFO: Saving data for MF04152: {'auction_closing_time': 1774972506.0, 'created_time': 1773303709.811489, 'last_price_update_time': 1774855877.299263}
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF04152') HTTP/1.1" 204 0
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_9338e06613b0037c81c9df0e11e8553d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:17 [auto1.de] INFO: Found listing with ID: GJ50570
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ50570%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [auto1.de] INFO: Scrape type for GJ50570: 1
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_993fb27c9a4b23877b477d70029bb91f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_993fb27c9a4b23877b477d70029bb91f.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg not downloaded yet
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ90334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR21145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN56575> (referer: https://www.auto1.com/v1/car-details-view/XN56575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ48067> (referer: https://www.auto1.com/v1/car-details-view/BZ48067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY33164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG30770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 07:31:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 07:31:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bcaa6490>
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Faa%252F03aa0af858d661e93cfc49c066e83d67%252Fpa%252FRC35240_259bb88dee568a506636670a33d2d89b.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_259bb88dee568a506636670a33d2d89b.jpg saved to cache
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 333c2e54-66f3-5bb7-b3d8-56eda620e372
2026-03-30 07:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 333c2e54-66f3-5bb7-b3d8-56eda620e372, skipping ID generation
2026-03-30 07:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333c2e54-66f3-5bb7-b3d8-56eda620e372 with scrape type 1
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 333c2e54-66f3-5bb7-b3d8-56eda620e372 sending to next pipeline
2026-03-30 07:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 333c2e54-66f3-5bb7-b3d8-56eda620e372, identifier: RC35240
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bebea950>
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_8359b5f1f160993d08ba6c76a0b26431.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8359b5f1f160993d08ba6c76a0b26431.jpg saved to cache
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_5a61468fa9c824c85855b43327e8e88e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:17 [auto1.de] INFO: Found listing with ID: VR14324
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR14324%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [auto1.de] INFO: Scrape type for VR14324: 2
2026-03-30 07:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with identifier: VR14324
2026-03-30 07:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with scrape type 2
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with scrape type 2
2026-03-30 07:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1cb028b-f272-54b1-8e6d-294f7ec26ac6, identifier: VR14324
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_017370993409338ade27f6c9cfb1a16c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_017370993409338ade27f6c9cfb1a16c.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_bc63506b4d74020d876f498730347eee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_bc63506b4d74020d876f498730347eee.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_3151abe59f8b201f8515a5828b57f07f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_3151abe59f8b201f8515a5828b57f07f.jpg not downloaded yet
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg not downloaded yet
2026-03-30 07:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 333c2e54-66f3-5bb7-b3d8-56eda620e372 with identifier: RC35240
2026-03-30 07:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 333c2e54-66f3-5bb7-b3d8-56eda620e372 with identifier: RC35240
2026-03-30 07:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 333c2e54-66f3-5bb7-b3d8-56eda620e372 with identifier: RC35240 to the API
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_259bb88dee568a506636670a33d2d89b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:24Z',
 'fuel_type': 'diesel',
 'id': '333c2e54-66f3-5bb7-b3d8-56eda620e372',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC35240',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 166884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4157872,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_259bb88dee568a506636670a33d2d89b.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_f0409872ef9b068482fe5672c5f6a777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_cf5c0f214498e9000a0a66c096d7f0a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_0d343f78461ff14f5f9a6f0d63ddd475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9e4fd02127c333a49a116719ecd9c8d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_220885933f77d4dd714ac337501319a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_9c7aa89200e8256e9a16aed29471975b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_46a72d6251056ba45cbc13312b144a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_4d22379a507057689a854da3b4777354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333c2e54-66f3-5bb7-b3d8-56eda620e372/333c2e54-66f3-5bb7-b3d8-56eda620e372_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/aa/03aa0af858d661e93cfc49c066e83d67/pa/RC35240_ab41a8db59cfdb057101dadbb61f4dbc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Life BlueMotion',
 'transmission': 'automatic',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC35240%27 HTTP/1.1" 200 None
2026-03-30 07:31:18 [auto1.de] INFO: Saving data for RC35240: {'created_time': 1774855878.410267, 'last_price_update_time': 1774855878.410277, 'auction_closing_time': 1774969344.0}
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC35240') HTTP/1.1" 204 0
2026-03-30 07:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with identifier: VR14324
2026-03-30 07:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with identifier: VR14324
2026-03-30 07:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1cb028b-f272-54b1-8e6d-294f7ec26ac6 with identifier: VR14324 to the API
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:12:50Z',
 'fuel_type': 'petrol',
 'id': 'c1cb028b-f272-54b1-8e6d-294f7ec26ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR14324',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 78315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-25',
 'seller_name': None,
 'title': 'Honda Civic 1.8 i-VTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2013}
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR14324%27 HTTP/1.1" 200 None
2026-03-30 07:31:18 [auto1.de] INFO: Saving data for VR14324: {'auction_closing_time': 1774969970.0, 'created_time': 1774378095.319156, 'last_price_update_time': 1774855878.97165}
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR14324') HTTP/1.1" 204 0
2026-03-30 07:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7bc550>
2026-03-30 07:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_9338e06613b0037c81c9df0e11e8553d.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_9338e06613b0037c81c9df0e11e8553d.jpg saved to cache
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:19 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [auto1.de] INFO: Scrape type for PA10623: 2
2026-03-30 07:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15908be2-9a55-5155-8fcd-80dd83bd5178 with identifier: PA10623
2026-03-30 07:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15908be2-9a55-5155-8fcd-80dd83bd5178 with scrape type 2
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15908be2-9a55-5155-8fcd-80dd83bd5178 with scrape type 2
2026-03-30 07:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15908be2-9a55-5155-8fcd-80dd83bd5178, identifier: PA10623
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_1f2830fc392c43cdba93253f5ad29842.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_1f2830fc392c43cdba93253f5ad29842.jpg not downloaded yet
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_0bbb890f1caf2417bee1aec797953054.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0bbb890f1caf2417bee1aec797953054.jpg not downloaded yet
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_b1264981b4ca3c03f601f890bb7740dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_b1264981b4ca3c03f601f890bb7740dd.jpg not downloaded yet
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_bae71e1958ea9b73117a77bef0ff4925.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_bae71e1958ea9b73117a77bef0ff4925.jpg not downloaded yet
2026-03-30 07:31:19 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 7211 | hits on page: 40
2026-03-30 07:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with identifier: XN56575
2026-03-30 07:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with scrape type 1
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_f38d1cdb6844d494cb9d344463e76734.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_f38d1cdb6844d494cb9d344463e76734.jpg not downloaded yet
2026-03-30 07:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d99703c-c60c-5083-a0dc-d4824a9876a5 with identifier: BZ48067
2026-03-30 07:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d99703c-c60c-5083-a0dc-d4824a9876a5 with scrape type 1
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg not downloaded yet
2026-03-30 07:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15908be2-9a55-5155-8fcd-80dd83bd5178 with identifier: PA10623
2026-03-30 07:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15908be2-9a55-5155-8fcd-80dd83bd5178 with identifier: PA10623
2026-03-30 07:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15908be2-9a55-5155-8fcd-80dd83bd5178 with identifier: PA10623 to the API
2026-03-30 07:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:10:10Z',
 'fuel_type': 'hybrid',
 'id': '15908be2-9a55-5155-8fcd-80dd83bd5178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA10623',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 139534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-07',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 Plug-in Hybrid Style iV',
 'transmission': 'automatic',
 'trim': 'Style iV',
 'year': 2020}
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [auto1.de] INFO: Saving data for PA10623: {'auction_closing_time': 1774969810.0, 'created_time': 1773660618.516562, 'last_price_update_time': 1774855880.424196}
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA10623') HTTP/1.1" 204 0
2026-03-30 07:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6ff690>
2026-03-30 07:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_5a61468fa9c824c85855b43327e8e88e.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_5a61468fa9c824c85855b43327e8e88e.jpg saved to cache
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:20 [auto1.de] INFO: Found listing with ID: YF78149
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78149%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [auto1.de] INFO: Scrape type for YF78149: 2
2026-03-30 07:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e38329-e428-50f8-a09b-17daf96971d3 with identifier: YF78149
2026-03-30 07:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e38329-e428-50f8-a09b-17daf96971d3 with scrape type 2
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e38329-e428-50f8-a09b-17daf96971d3 with scrape type 2
2026-03-30 07:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75e38329-e428-50f8-a09b-17daf96971d3, identifier: YF78149
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg not downloaded yet
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg not downloaded yet
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg not downloaded yet
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg not downloaded yet
2026-03-30 07:31:20 [auto1.de] INFO: Found listing with ID: KU93017
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93017%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [auto1.de] INFO: Scrape type for KU93017: 2
2026-03-30 07:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with identifier: KU93017
2026-03-30 07:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with scrape type 2
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with scrape type 2
2026-03-30 07:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cdbae75-141b-52e9-8e13-0cbd11bb62f6, identifier: KU93017
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_e397c45d7f950dacb80d78723f577ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_e397c45d7f950dacb80d78723f577ea9.jpg not downloaded yet
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg not downloaded yet
2026-03-30 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN83925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75e38329-e428-50f8-a09b-17daf96971d3 with identifier: YF78149
2026-03-30 07:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75e38329-e428-50f8-a09b-17daf96971d3 with identifier: YF78149
2026-03-30 07:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75e38329-e428-50f8-a09b-17daf96971d3 with identifier: YF78149 to the API
2026-03-30 07:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:06:54Z',
 'fuel_type': 'petrol',
 'id': '75e38329-e428-50f8-a09b-17daf96971d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF78149',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 222294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-21',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78149%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [auto1.de] INFO: Saving data for YF78149: {'auction_closing_time': 1774969614.0, 'created_time': 1774118856.722064, 'last_price_update_time': 1774855881.203412}
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF78149') HTTP/1.1" 204 0
2026-03-30 07:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with identifier: KU93017
2026-03-30 07:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with identifier: KU93017
2026-03-30 07:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cdbae75-141b-52e9-8e13-0cbd11bb62f6 with identifier: KU93017 to the API
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:53:51Z',
 'fuel_type': 'petrol',
 'id': '1cdbae75-141b-52e9-8e13-0cbd11bb62f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU93017',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 173062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Go+ 2WD',
 'transmission': 'manual',
 'trim': 'Go+ 2WD',
 'year': 2017}
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93017%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [auto1.de] INFO: Saving data for KU93017: {'auction_closing_time': 1774972431.0, 'created_time': 1774330855.791281, 'last_price_update_time': 1774855881.583149}
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU93017') HTTP/1.1" 204 0
2026-03-30 07:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc90a050>
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg saved to cache
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:31:21 [auto1.de] INFO: Found listing with ID: ZB29861
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB29861%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [auto1.de] INFO: Scrape type for ZB29861: 1
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg not downloaded yet
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg not downloaded yet
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_c9f85a6798dd30dcc28a740f27edef98.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_c9f85a6798dd30dcc28a740f27edef98.jpg not downloaded yet
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_577cd8f544a819653b22d0e249470c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_577cd8f544a819653b22d0e249470c4a.jpg not downloaded yet
2026-03-30 07:31:21 [auto1.de] INFO: Found listing with ID: AD78216
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD78216%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [auto1.de] INFO: Scrape type for AD78216: 1
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_8b81e122bbc01852666b70f8caf441c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_8b81e122bbc01852666b70f8caf441c3.jpg not downloaded yet
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg not downloaded yet
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc747010>
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg saved to cache
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc696150>
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg saved to cache
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:31:21 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-30 07:31:21 [auto1.de] INFO: Scrape type for RM92330: 2
2026-03-30 07:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-30 07:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977589e4-083d-5996-941d-cb095a62037f with scrape type 2
2026-03-30 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977589e4-083d-5996-941d-cb095a62037f with scrape type 2
2026-03-30 07:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977589e4-083d-5996-941d-cb095a62037f, identifier: RM92330
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_320a02f0381c2f5c7520db94b76a462f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_320a02f0381c2f5c7520db94b76a462f.jpg not downloaded yet
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_1eb62f243aef5e481b454fdddff7f31f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_1eb62f243aef5e481b454fdddff7f31f.jpg not downloaded yet
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg not downloaded yet
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_7b6790fb946098ba613245d5fb2076e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_7b6790fb946098ba613245d5fb2076e2.jpg not downloaded yet
2026-03-30 07:31:22 [auto1.de] INFO: Found listing with ID: JH04930
2026-03-30 07:31:22 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 07:31:22 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ33813%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [auto1.de] INFO: Scrape type for SZ33813: 2
2026-03-30 07:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with identifier: SZ33813
2026-03-30 07:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with scrape type 2
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with scrape type 2
2026-03-30 07:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06eeb634-fefd-5c54-8f1f-dadd7c382d01, identifier: SZ33813
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg not downloaded yet
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg not downloaded yet
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc74a790>
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg saved to cache
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca3d050>
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg saved to cache
2026-03-30 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_f38d1cdb6844d494cb9d344463e76734.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-30 07:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-30 07:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330 to the API
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:02:03Z',
 'fuel_type': 'diesel',
 'id': '977589e4-083d-5996-941d-cb095a62037f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM92330',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 198813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'BMW 5er 530d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-30 07:31:22 [auto1.de] INFO: Saving data for RM92330: {'auction_closing_time': 1774969323.0, 'created_time': 1773305970.064733, 'last_price_update_time': 1774855882.785328}
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM92330') HTTP/1.1" 204 0
2026-03-30 07:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with identifier: SZ33813
2026-03-30 07:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with identifier: SZ33813
2026-03-30 07:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06eeb634-fefd-5c54-8f1f-dadd7c382d01 with identifier: SZ33813 to the API
2026-03-30 07:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:27:39Z',
 'fuel_type': 'petrol',
 'id': '06eeb634-fefd-5c54-8f1f-dadd7c382d01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ33813',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 126560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2008}
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ33813%27 HTTP/1.1" 200 None
2026-03-30 07:31:23 [auto1.de] INFO: Saving data for SZ33813: {'auction_closing_time': 1774970859.0, 'created_time': 1774262839.747013, 'last_price_update_time': 1774855883.879353}
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ33813') HTTP/1.1" 204 0
2026-03-30 07:31:23 [auto1.de] INFO: Found listing with ID: KU93017
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93017%27 HTTP/1.1" 200 None
2026-03-30 07:31:23 [auto1.de] INFO: Scrape type for KU93017: 0
2026-03-30 07:31:23 [auto1.de] INFO: Found listing with ID: AD78216
2026-03-30 07:31:23 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL52621%27 HTTP/1.1" 200 None
2026-03-30 07:31:23 [auto1.de] INFO: Scrape type for EL52621: 1
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_d698ae0494a66a0db0016f97803171d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_d698ae0494a66a0db0016f97803171d0.jpg not downloaded yet
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg not downloaded yet
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: JH04930
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ33813%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for SZ33813: 0
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: FY49050
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY49050%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for FY49050: 1
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_efef08c04d9b339851dd328332492f18.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_efef08c04d9b339851dd328332492f18.jpg not downloaded yet
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_acdef7ff00f225466b643f4d4729021e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_acdef7ff00f225466b643f4d4729021e.jpg not downloaded yet
2026-03-30 07:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc674490>
2026-03-30 07:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_f38d1cdb6844d494cb9d344463e76734.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_f38d1cdb6844d494cb9d344463e76734.jpg saved to cache
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: EA94412
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA94412%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for EA94412: 2
2026-03-30 07:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with identifier: EA94412
2026-03-30 07:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with scrape type 2
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with scrape type 2
2026-03-30 07:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823cd9a0-892a-593a-b4cb-eab33a1b04f4, identifier: EA94412
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg not downloaded yet
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg not downloaded yet
2026-03-30 07:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with identifier: EA94412
2026-03-30 07:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with identifier: EA94412
2026-03-30 07:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823cd9a0-892a-593a-b4cb-eab33a1b04f4 with identifier: EA94412 to the API
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:02:20Z',
 'fuel_type': 'diesel',
 'id': '823cd9a0-892a-593a-b4cb-eab33a1b04f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA94412',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 202568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA94412%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Saving data for EA94412: {'auction_closing_time': 1774969340.0, 'created_time': 1773303651.947832, 'last_price_update_time': 1774855884.676441}
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA94412') HTTP/1.1" 204 0
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: KD88298
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD88298%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for KD88298: 1
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_0640ef664684142afcf1bc599a7d3e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0640ef664684142afcf1bc599a7d3e71.jpg not downloaded yet
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: HD75815
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75815%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for HD75815: 1
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg not downloaded yet
2026-03-30 07:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB70642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ50570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG30770> (referer: https://www.auto1.com/v1/car-details-view/EG30770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: AL25278
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL25278%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for AL25278: 1
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_4544993712ff27b8512ec8fe27e304d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4544993712ff27b8512ec8fe27e304d7.jpg not downloaded yet
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: VW31483
2026-03-30 07:31:24 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN85261%27 HTTP/1.1" 200 None
2026-03-30 07:31:24 [auto1.de] INFO: Scrape type for UN85261: 2
2026-03-30 07:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990e8df6-ea43-5692-acb7-d50b143ae054 with identifier: UN85261
2026-03-30 07:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990e8df6-ea43-5692-acb7-d50b143ae054 with scrape type 2
2026-03-30 07:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 990e8df6-ea43-5692-acb7-d50b143ae054 with scrape type 2
2026-03-30 07:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 990e8df6-ea43-5692-acb7-d50b143ae054, identifier: UN85261
2026-03-30 07:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 990e8df6-ea43-5692-acb7-d50b143ae054 with identifier: UN85261
2026-03-30 07:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 990e8df6-ea43-5692-acb7-d50b143ae054 with identifier: UN85261
2026-03-30 07:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 990e8df6-ea43-5692-acb7-d50b143ae054 with identifier: UN85261 to the API
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:41:30Z',
 'fuel_type': 'diesel',
 'id': '990e8df6-ea43-5692-acb7-d50b143ae054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN85261',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 72828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2020}
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN85261%27 HTTP/1.1" 200 None
2026-03-30 07:31:25 [auto1.de] INFO: Saving data for UN85261: {'auction_closing_time': 1774971690.0, 'created_time': 1773132356.590161, 'last_price_update_time': 1774855885.41268}
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN85261') HTTP/1.1" 204 0
2026-03-30 07:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:25 [auto1.de] INFO: Found listing with ID: DE44108
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE44108%27 HTTP/1.1" 200 None
2026-03-30 07:31:25 [auto1.de] INFO: Scrape type for DE44108: 2
2026-03-30 07:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7197affb-0518-50ed-aecf-d8f86f73b5b5 with identifier: DE44108
2026-03-30 07:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7197affb-0518-50ed-aecf-d8f86f73b5b5 with scrape type 2
2026-03-30 07:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7197affb-0518-50ed-aecf-d8f86f73b5b5 with scrape type 2
2026-03-30 07:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7197affb-0518-50ed-aecf-d8f86f73b5b5, identifier: DE44108
2026-03-30 07:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0640ef664684142afcf1bc599a7d3e71.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7197affb-0518-50ed-aecf-d8f86f73b5b5 with identifier: DE44108
2026-03-30 07:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7197affb-0518-50ed-aecf-d8f86f73b5b5 with identifier: DE44108
2026-03-30 07:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7197affb-0518-50ed-aecf-d8f86f73b5b5 with identifier: DE44108 to the API
2026-03-30 07:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:05:01Z',
 'fuel_type': 'petrol',
 'id': '7197affb-0518-50ed-aecf-d8f86f73b5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE44108',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 151961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2008}
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE44108%27 HTTP/1.1" 200 None
2026-03-30 07:31:26 [auto1.de] INFO: Saving data for DE44108: {'auction_closing_time': 1774969501.0, 'created_time': 1774262084.081686, 'last_price_update_time': 1774855886.421088}
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE44108') HTTP/1.1" 204 0
2026-03-30 07:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be64305-9caf-5158-b2f1-8feda56e0553 with identifier: EG30770
2026-03-30 07:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be64305-9caf-5158-b2f1-8feda56e0553 with scrape type 1
2026-03-30 07:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_7a0ede8b180e3d39cf9cb604719465be.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_7a0ede8b180e3d39cf9cb604719465be.jpg not downloaded yet
2026-03-30 07:31:26 [auto1.de] INFO: Found listing with ID: PS73688
2026-03-30 07:31:26 [auto1.de] INFO: Found listing with ID: HK59987
2026-03-30 07:31:26 [auto1.de] INFO: Found listing with ID: KU46528
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU46528%27 HTTP/1.1" 200 None
2026-03-30 07:31:26 [auto1.de] INFO: Scrape type for KU46528: 2
2026-03-30 07:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4189e618-f762-5d70-97f6-fecaf07a9c9b with identifier: KU46528
2026-03-30 07:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4189e618-f762-5d70-97f6-fecaf07a9c9b with scrape type 2
2026-03-30 07:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4189e618-f762-5d70-97f6-fecaf07a9c9b with scrape type 2
2026-03-30 07:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4189e618-f762-5d70-97f6-fecaf07a9c9b, identifier: KU46528
2026-03-30 07:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4189e618-f762-5d70-97f6-fecaf07a9c9b with identifier: KU46528
2026-03-30 07:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4189e618-f762-5d70-97f6-fecaf07a9c9b with identifier: KU46528
2026-03-30 07:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4189e618-f762-5d70-97f6-fecaf07a9c9b with identifier: KU46528 to the API
2026-03-30 07:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:21Z',
 'fuel_type': 'diesel',
 'id': '4189e618-f762-5d70-97f6-fecaf07a9c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU46528',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU46528%27 HTTP/1.1" 200 None
2026-03-30 07:31:27 [auto1.de] INFO: Saving data for KU46528: {'auction_closing_time': 1774969881.0, 'created_time': 1773686280.87867, 'last_price_update_time': 1774855887.878385}
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU46528') HTTP/1.1" 204 0
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_884102e8d93f74dd019710c4e4f1c074.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_884102e8d93f74dd019710c4e4f1c074.jpg not downloaded yet
2026-03-30 07:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK26573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:27 [auto1.de] INFO: Found listing with ID: GG93073
2026-03-30 07:31:27 [auto1.de] INFO: Found listing with ID: JV37184
2026-03-30 07:31:27 [auto1.de] INFO: Found listing with ID: CS96512
2026-03-30 07:31:27 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-30 07:31:27 [auto1.de] INFO: Found listing with ID: FN76281
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN76281%27 HTTP/1.1" 200 None
2026-03-30 07:31:27 [auto1.de] INFO: Scrape type for FN76281: 2
2026-03-30 07:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with identifier: FN76281
2026-03-30 07:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with scrape type 2
2026-03-30 07:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with scrape type 2
2026-03-30 07:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd39a18-6a0e-5601-b54f-fd92c28dae2d, identifier: FN76281
2026-03-30 07:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY33164> (referer: https://www.auto1.com/v1/car-details-view/MY33164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR38686> (referer: https://www.auto1.com/v1/car-details-view/HR38686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE47556> (referer: https://www.auto1.com/v1/car-details-view/ZE47556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4c9450>
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg saved to cache
2026-03-30 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc740210>
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_0640ef664684142afcf1bc599a7d3e71.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0640ef664684142afcf1bc599a7d3e71.jpg saved to cache
2026-03-30 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4544993712ff27b8512ec8fe27e304d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with identifier: FN76281
2026-03-30 07:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with identifier: FN76281
2026-03-30 07:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd39a18-6a0e-5601-b54f-fd92c28dae2d with identifier: FN76281 to the API
2026-03-30 07:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:26:47Z',
 'fuel_type': 'diesel',
 'id': '5cd39a18-6a0e-5601-b54f-fd92c28dae2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN76281',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 131983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2014}
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN76281%27 HTTP/1.1" 200 None
2026-03-30 07:31:29 [auto1.de] INFO: Saving data for FN76281: {'auction_closing_time': 1774970807.0, 'created_time': 1774294369.202118, 'last_price_update_time': 1774855889.365593}
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN76281') HTTP/1.1" 204 0
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_ad4f9883759e406f4425a052e18dd3eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_ad4f9883759e406f4425a052e18dd3eb.jpg not downloaded yet
2026-03-30 07:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF16052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:29 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-30 07:31:29 [auto1.de] INFO: Scrape type for TT64948: 2
2026-03-30 07:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd565b2a-6208-5197-814e-8b26ccc15490 with identifier: TT64948
2026-03-30 07:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd565b2a-6208-5197-814e-8b26ccc15490 with scrape type 2
2026-03-30 07:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd565b2a-6208-5197-814e-8b26ccc15490 with scrape type 2
2026-03-30 07:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd565b2a-6208-5197-814e-8b26ccc15490, identifier: TT64948
2026-03-30 07:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd565b2a-6208-5197-814e-8b26ccc15490 with identifier: TT64948
2026-03-30 07:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd565b2a-6208-5197-814e-8b26ccc15490 with identifier: TT64948
2026-03-30 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd565b2a-6208-5197-814e-8b26ccc15490 with identifier: TT64948 to the API
2026-03-30 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:17:20Z',
 'fuel_type': 'petrol',
 'id': 'bd565b2a-6208-5197-814e-8b26ccc15490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT64948',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 79894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-22',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300',
 'transmission': 'automatic',
 'trim': 'Cupra 300',
 'year': 2018}
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-30 07:31:31 [auto1.de] INFO: Saving data for TT64948: {'auction_closing_time': 1774970240.0, 'created_time': 1774294876.783863, 'last_price_update_time': 1774855891.709159}
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT64948') HTTP/1.1" 204 0
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg not downloaded yet
2026-03-30 07:31:31 [auto1.de] INFO: Found listing with ID: YM08945
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM08945%27 HTTP/1.1" 200 None
2026-03-30 07:31:31 [auto1.de] INFO: Scrape type for YM08945: 2
2026-03-30 07:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with identifier: YM08945
2026-03-30 07:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with scrape type 2
2026-03-30 07:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with scrape type 2
2026-03-30 07:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3cbe0c4-82c9-5651-bc79-f3431f4bf832, identifier: YM08945
2026-03-30 07:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_7a0ede8b180e3d39cf9cb604719465be.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with identifier: YM08945
2026-03-30 07:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with identifier: YM08945
2026-03-30 07:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3cbe0c4-82c9-5651-bc79-f3431f4bf832 with identifier: YM08945 to the API
2026-03-30 07:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:58:43Z',
 'fuel_type': 'hybrid',
 'id': 'a3cbe0c4-82c9-5651-bc79-f3431f4bf832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM08945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 113592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM08945%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [auto1.de] INFO: Saving data for YM08945: {'auction_closing_time': 1774972723.0, 'created_time': 1773467409.075858, 'last_price_update_time': 1774855892.467285}
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM08945') HTTP/1.1" 204 0
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_67b86d427833e55658d0922590c426d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_67b86d427833e55658d0922590c426d5.jpg not downloaded yet
2026-03-30 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d00f78-5e9a-534b-ae58-f923aaad228a with identifier: MY33164
2026-03-30 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d00f78-5e9a-534b-ae58-f923aaad228a with scrape type 1
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11d00f78-5e9a-534b-ae58-f923aaad228a
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_451d53d2f2ccac53e6e0601eeb8a2433.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_451d53d2f2ccac53e6e0601eeb8a2433.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_22d89c9384c289a1fc256d15ca1a33f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_22d89c9384c289a1fc256d15ca1a33f1.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_f517b86d0dc4a0f92ca71210de06ac56.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_f517b86d0dc4a0f92ca71210de06ac56.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_a317792f752cf8d96ccc8c9e3bd069eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a317792f752cf8d96ccc8c9e3bd069eb.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_6cfe6064056b72b2361de184f7f1124b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_6cfe6064056b72b2361de184f7f1124b.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_a2ab8f463e4d217a9ec65f4ed6be0d21.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a2ab8f463e4d217a9ec65f4ed6be0d21.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_86062dc5327ec8303575900ed77c08e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_86062dc5327ec8303575900ed77c08e7.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_1f455f7f7a334ef4b4e0ca3f435eb982.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_1f455f7f7a334ef4b4e0ca3f435eb982.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_4bfc16ea9162f926028bd17d2bf7f1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_4bfc16ea9162f926028bd17d2bf7f1e1.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F5e%252F095e99cb110fd3a3f847d781b2815ec9%252Fpa%252FMY33164_8c9f4e789ad4730c52e25ab7f1a2d83a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_8c9f4e789ad4730c52e25ab7f1a2d83a.jpg already downloaded
2026-03-30 07:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11d00f78-5e9a-534b-ae58-f923aaad228a, identifier: MY33164
2026-03-30 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with identifier: HR38686
2026-03-30 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with scrape type 1
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg not downloaded yet
2026-03-30 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9461b886-6dee-50c7-86ae-f8102db69591 with identifier: ZE47556
2026-03-30 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9461b886-6dee-50c7-86ae-f8102db69591 with scrape type 1
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9461b886-6dee-50c7-86ae-f8102db69591
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_90b1b37de753db809e5e5d82f4a2f720.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_90b1b37de753db809e5e5d82f4a2f720.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_ac8dca3c53cd82b8a495349fb76d1fa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ac8dca3c53cd82b8a495349fb76d1fa8.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_2a95b391adfdd196c47f168aa7e79f9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_2a95b391adfdd196c47f168aa7e79f9e.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_a5d395b1c15135be3c286cb7f1bc01c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_a5d395b1c15135be3c286cb7f1bc01c1.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_f1dceed84a59ba3057412bbb1eef9ab7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_f1dceed84a59ba3057412bbb1eef9ab7.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_ed243dbd7654433de07a23e79b0b6253.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ed243dbd7654433de07a23e79b0b6253.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_12e74ca49fe404dd5dbbf1cb4c44a46b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_12e74ca49fe404dd5dbbf1cb4c44a46b.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_86710249b5933c8dc381389a7501680d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_86710249b5933c8dc381389a7501680d.jpg already downloaded
2026-03-30 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_abbb599bce00fd6b664b4f931adeb988.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_abbb599bce00fd6b664b4f931adeb988.jpg already downloaded
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F32%252F0132390e62bc508945f956a6afc20d49%252Fpa%252FZE47556_9da6d3b7259f58ae2810e3d9ec536f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_9da6d3b7259f58ae2810e3d9ec536f2a.jpg already downloaded
2026-03-30 07:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9461b886-6dee-50c7-86ae-f8102db69591, identifier: ZE47556
2026-03-30 07:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc660750>
2026-03-30 07:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_4544993712ff27b8512ec8fe27e304d7.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4544993712ff27b8512ec8fe27e304d7.jpg saved to cache
2026-03-30 07:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_884102e8d93f74dd019710c4e4f1c074.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:33 [auto1.de] INFO: Found listing with ID: KB35641
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB35641%27 HTTP/1.1" 200 None
2026-03-30 07:31:33 [auto1.de] INFO: Scrape type for KB35641: 2
2026-03-30 07:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc79484-8b03-520d-af0f-f306a118fd90 with identifier: KB35641
2026-03-30 07:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc79484-8b03-520d-af0f-f306a118fd90 with scrape type 2
2026-03-30 07:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc79484-8b03-520d-af0f-f306a118fd90 with scrape type 2
2026-03-30 07:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fc79484-8b03-520d-af0f-f306a118fd90, identifier: KB35641
2026-03-30 07:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR21145> (referer: https://www.auto1.com/v1/car-details-view/BR21145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN83925> (referer: https://www.auto1.com/v1/car-details-view/VN83925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11d00f78-5e9a-534b-ae58-f923aaad228a with identifier: MY33164
2026-03-30 07:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11d00f78-5e9a-534b-ae58-f923aaad228a with identifier: MY33164
2026-03-30 07:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11d00f78-5e9a-534b-ae58-f923aaad228a with identifier: MY33164 to the API
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY33164>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:28:00Z',
 'fuel_type': 'petrol',
 'id': '11d00f78-5e9a-534b-ae58-f923aaad228a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY33164',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 28311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_451d53d2f2ccac53e6e0601eeb8a2433.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_22d89c9384c289a1fc256d15ca1a33f1.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_f517b86d0dc4a0f92ca71210de06ac56.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a317792f752cf8d96ccc8c9e3bd069eb.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_6cfe6064056b72b2361de184f7f1124b.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a2ab8f463e4d217a9ec65f4ed6be0d21.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_86062dc5327ec8303575900ed77c08e7.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_1f455f7f7a334ef4b4e0ca3f435eb982.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_4bfc16ea9162f926028bd17d2bf7f1e1.jpg',
                'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_8c9f4e789ad4730c52e25ab7f1a2d83a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_451d53d2f2ccac53e6e0601eeb8a2433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_22d89c9384c289a1fc256d15ca1a33f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_f517b86d0dc4a0f92ca71210de06ac56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a317792f752cf8d96ccc8c9e3bd069eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_6cfe6064056b72b2361de184f7f1124b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_a2ab8f463e4d217a9ec65f4ed6be0d21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_86062dc5327ec8303575900ed77c08e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_1f455f7f7a334ef4b4e0ca3f435eb982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_4bfc16ea9162f926028bd17d2bf7f1e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d00f78-5e9a-534b-ae58-f923aaad228a/11d00f78-5e9a-534b-ae58-f923aaad228a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/5e/095e99cb110fd3a3f847d781b2815ec9/pa/MY33164_8c9f4e789ad4730c52e25ab7f1a2d83a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDI N Performance',
 'transmission': 'automatic',
 'trim': 'N Performance',
 'year': 2024}
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY33164%27 HTTP/1.1" 200 None
2026-03-30 07:31:33 [auto1.de] INFO: Saving data for MY33164: {'created_time': 1774855893.643539, 'last_price_update_time': 1774855893.643551, 'auction_closing_time': 1774970880.0}
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY33164') HTTP/1.1" 204 0
2026-03-30 07:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9461b886-6dee-50c7-86ae-f8102db69591 with identifier: ZE47556
2026-03-30 07:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9461b886-6dee-50c7-86ae-f8102db69591 with identifier: ZE47556
2026-03-30 07:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9461b886-6dee-50c7-86ae-f8102db69591 with identifier: ZE47556 to the API
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE47556>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:59:27Z',
 'fuel_type': 'diesel',
 'id': '9461b886-6dee-50c7-86ae-f8102db69591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE47556',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 138989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_90b1b37de753db809e5e5d82f4a2f720.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ac8dca3c53cd82b8a495349fb76d1fa8.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_2a95b391adfdd196c47f168aa7e79f9e.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_a5d395b1c15135be3c286cb7f1bc01c1.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_f1dceed84a59ba3057412bbb1eef9ab7.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ed243dbd7654433de07a23e79b0b6253.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_12e74ca49fe404dd5dbbf1cb4c44a46b.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_86710249b5933c8dc381389a7501680d.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_abbb599bce00fd6b664b4f931adeb988.jpg',
                'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_9da6d3b7259f58ae2810e3d9ec536f2a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_90b1b37de753db809e5e5d82f4a2f720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ac8dca3c53cd82b8a495349fb76d1fa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_2a95b391adfdd196c47f168aa7e79f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_a5d395b1c15135be3c286cb7f1bc01c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_f1dceed84a59ba3057412bbb1eef9ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_ed243dbd7654433de07a23e79b0b6253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_12e74ca49fe404dd5dbbf1cb4c44a46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_86710249b5933c8dc381389a7501680d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_abbb599bce00fd6b664b4f931adeb988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9461b886-6dee-50c7-86ae-f8102db69591/9461b886-6dee-50c7-86ae-f8102db69591_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/32/0132390e62bc508945f956a6afc20d49/pa/ZE47556_9da6d3b7259f58ae2810e3d9ec536f2a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE47556%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [auto1.de] INFO: Saving data for ZE47556: {'created_time': 1774855894.008635, 'last_price_update_time': 1774855894.008649, 'auction_closing_time': 1774972767.0}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE47556') HTTP/1.1" 204 0
2026-03-30 07:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fc79484-8b03-520d-af0f-f306a118fd90 with identifier: KB35641
2026-03-30 07:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fc79484-8b03-520d-af0f-f306a118fd90 with identifier: KB35641
2026-03-30 07:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fc79484-8b03-520d-af0f-f306a118fd90 with identifier: KB35641 to the API
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:27:00Z',
 'fuel_type': 'petrol',
 'id': '6fc79484-8b03-520d-af0f-f306a118fd90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB35641',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 31378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Fun X',
 'transmission': 'manual',
 'trim': 'Fun X',
 'year': 2007}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB35641%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [auto1.de] INFO: Saving data for KB35641: {'auction_closing_time': 1774970820.0, 'created_time': 1774293974.030606, 'last_price_update_time': 1774855894.399981}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB35641') HTTP/1.1" 204 0
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg not downloaded yet
2026-03-30 07:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_01d806818c84698e71dd60e27cfeafbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_01d806818c84698e71dd60e27cfeafbd.jpg not downloaded yet
2026-03-30 07:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:34 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [auto1.de] INFO: Scrape type for AC60710: 2
2026-03-30 07:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaa73ef-04f5-5d4c-b406-f43c561cb209 with identifier: AC60710
2026-03-30 07:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaa73ef-04f5-5d4c-b406-f43c561cb209 with scrape type 2
2026-03-30 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaa73ef-04f5-5d4c-b406-f43c561cb209 with scrape type 2
2026-03-30 07:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebaa73ef-04f5-5d4c-b406-f43c561cb209, identifier: AC60710
2026-03-30 07:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebaa73ef-04f5-5d4c-b406-f43c561cb209 with identifier: AC60710
2026-03-30 07:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebaa73ef-04f5-5d4c-b406-f43c561cb209 with identifier: AC60710
2026-03-30 07:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebaa73ef-04f5-5d4c-b406-f43c561cb209 with identifier: AC60710 to the API
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:40:47Z',
 'fuel_type': 'diesel',
 'id': 'ebaa73ef-04f5-5d4c-b406-f43c561cb209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC60710',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 260005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'BMW 5er 540d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [auto1.de] INFO: Saving data for AC60710: {'auction_closing_time': 1774971647.0, 'created_time': 1773661948.878249, 'last_price_update_time': 1774855894.925712}
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC60710') HTTP/1.1" 204 0
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg not downloaded yet
2026-03-30 07:31:34 [auto1.de] INFO: Found listing with ID: HB23810
2026-03-30 07:31:34 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19730%27 HTTP/1.1" 200 None
2026-03-30 07:31:34 [auto1.de] INFO: Scrape type for PJ19730: 2
2026-03-30 07:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 095f2a19-a841-570e-917f-ebff6698cd96 with identifier: PJ19730
2026-03-30 07:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 095f2a19-a841-570e-917f-ebff6698cd96 with scrape type 2
2026-03-30 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 095f2a19-a841-570e-917f-ebff6698cd96 with scrape type 2
2026-03-30 07:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 095f2a19-a841-570e-917f-ebff6698cd96, identifier: PJ19730
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc57d990>
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_7a0ede8b180e3d39cf9cb604719465be.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_7a0ede8b180e3d39cf9cb604719465be.jpg saved to cache
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beb15850>
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_884102e8d93f74dd019710c4e4f1c074.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_884102e8d93f74dd019710c4e4f1c074.jpg saved to cache
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:35 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 7219 | hits on page: 40
2026-03-30 07:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b1faeb-6824-5c49-85da-4c7469f6f528 with identifier: BR21145
2026-03-30 07:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b1faeb-6824-5c49-85da-4c7469f6f528 with scrape type 1
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_40aee32a299e8507eed47c1a639e60b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_40aee32a299e8507eed47c1a639e60b3.jpg not downloaded yet
2026-03-30 07:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b23751-bdd1-5a47-beea-0756fc911514 with identifier: VN83925
2026-03-30 07:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b23751-bdd1-5a47-beea-0756fc911514 with scrape type 1
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg not downloaded yet
2026-03-30 07:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_993fb27c9a4b23877b477d70029bb91f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 095f2a19-a841-570e-917f-ebff6698cd96 with identifier: PJ19730
2026-03-30 07:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 095f2a19-a841-570e-917f-ebff6698cd96 with identifier: PJ19730
2026-03-30 07:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 095f2a19-a841-570e-917f-ebff6698cd96 with identifier: PJ19730 to the API
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:17:34Z',
 'fuel_type': 'petrol',
 'id': '095f2a19-a841-570e-917f-ebff6698cd96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ19730',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 30462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19730%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [auto1.de] INFO: Saving data for PJ19730: {'auction_closing_time': 1774970254.0, 'created_time': 1774292699.020218, 'last_price_update_time': 1774855895.583089}
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ19730') HTTP/1.1" 204 0
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_31e3777e8784fc61cb40e7479fd18344.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_31e3777e8784fc61cb40e7479fd18344.jpg not downloaded yet
2026-03-30 07:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_67b86d427833e55658d0922590c426d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:35 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [auto1.de] INFO: Scrape type for TD77753: 2
2026-03-30 07:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-30 07:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-30 07:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e940e327-0927-5940-aa1d-61887c2dbaea, identifier: TD77753
2026-03-30 07:31:35 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19730%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [auto1.de] INFO: Scrape type for PJ19730: 0
2026-03-30 07:31:35 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [auto1.de] INFO: Scrape type for TD77753: 2
2026-03-30 07:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-30 07:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e940e327-0927-5940-aa1d-61887c2dbaea, identifier: TD77753
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_905d7da74599f6c40eddbccb6453c0ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_905d7da74599f6c40eddbccb6453c0ae.jpg not downloaded yet
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg not downloaded yet
2026-03-30 07:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-30 07:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-30 07:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753 to the API
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:35:18Z',
 'fuel_type': 'diesel',
 'id': 'e940e327-0927-5940-aa1d-61887c2dbaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD77753',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 295390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2019}
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [auto1.de] INFO: Saving data for TD77753: {'auction_closing_time': 1774971318.0, 'created_time': 1772546704.381304, 'last_price_update_time': 1774855896.264774}
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD77753') HTTP/1.1" 204 0
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_3c383e522df98122ae02ffba911c7ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_3c383e522df98122ae02ffba911c7ee3.jpg not downloaded yet
2026-03-30 07:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-30 07:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-30 07:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753 to the API
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:35:18Z',
 'fuel_type': 'diesel',
 'id': 'e940e327-0927-5940-aa1d-61887c2dbaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD77753',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 295390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2019}
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [auto1.de] INFO: Saving data for TD77753: {'auction_closing_time': 1774971318.0, 'created_time': 1772546704.381304, 'last_price_update_time': 1774855896.570799}
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD77753') HTTP/1.1" 204 0
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF77211%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [auto1.de] INFO: Scrape type for BF77211: 1
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_afcbc7f3c3b825c846417fed7e448c10.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_afcbc7f3c3b825c846417fed7e448c10.jpg not downloaded yet
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_c0bc303efc0f703deac0e06cfeab193d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_c0bc303efc0f703deac0e06cfeab193d.jpg not downloaded yet
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD88298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3e530bc68c434de7f41da33482285112.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc56c910>
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_993fb27c9a4b23877b477d70029bb91f.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_993fb27c9a4b23877b477d70029bb91f.jpg saved to cache
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc93a650>
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg saved to cache
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc57b910>
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_67b86d427833e55658d0922590c426d5.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_67b86d427833e55658d0922590c426d5.jpg saved to cache
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN21197%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [auto1.de] INFO: Scrape type for PN21197: 1
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_13d545a8248ef8581b96da307df7d9ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_13d545a8248ef8581b96da307df7d9ac.jpg not downloaded yet
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_81af1e87d9ad7d21a8e19eda19276749.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81af1e87d9ad7d21a8e19eda19276749.jpg not downloaded yet
2026-03-30 07:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_ea343fc93eb22b6b1d939aa012892d61.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 07:31:36 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE43577%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [auto1.de] INFO: Scrape type for AE43577: 1
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_699b193a9ebe263b6721d162a48ef530.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_699b193a9ebe263b6721d162a48ef530.jpg not downloaded yet
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_81f425e1003f3353eedda58878780d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81f425e1003f3353eedda58878780d44.jpg not downloaded yet
2026-03-30 07:31:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc404ad0>
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3e530bc68c434de7f41da33482285112.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3e530bc68c434de7f41da33482285112.jpg saved to cache
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc899cd0>
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg saved to cache
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_40aee32a299e8507eed47c1a639e60b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [auto1.de] INFO: Scrape type for AG29353: 2
2026-03-30 07:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353
2026-03-30 07:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d55321-aa18-5be1-82bb-942faabc71a7 with scrape type 2
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d55321-aa18-5be1-82bb-942faabc71a7 with scrape type 2
2026-03-30 07:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99d55321-aa18-5be1-82bb-942faabc71a7, identifier: AG29353
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 07:31:37 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [auto1.de] INFO: Scrape type for AG29353: 2
2026-03-30 07:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d55321-aa18-5be1-82bb-942faabc71a7 with scrape type 2
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d55321-aa18-5be1-82bb-942faabc71a7 with scrape type 2
2026-03-30 07:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99d55321-aa18-5be1-82bb-942faabc71a7, identifier: AG29353
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg not downloaded yet
2026-03-30 07:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353
2026-03-30 07:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353
2026-03-30 07:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353 to the API
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:01:26Z',
 'fuel_type': 'petrol',
 'id': '99d55321-aa18-5be1-82bb-942faabc71a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG29353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 138894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 07:31:37 [auto1.de] INFO: Saving data for AG29353: {'auction_closing_time': 1774969286.0, 'created_time': 1774378378.307814, 'last_price_update_time': 1774855897.848101}
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG29353') HTTP/1.1" 204 0
2026-03-30 07:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353
2026-03-30 07:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353
2026-03-30 07:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99d55321-aa18-5be1-82bb-942faabc71a7 with identifier: AG29353 to the API
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:01:26Z',
 'fuel_type': 'petrol',
 'id': '99d55321-aa18-5be1-82bb-942faabc71a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG29353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 138894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 07:31:38 [auto1.de] INFO: Saving data for AG29353: {'auction_closing_time': 1774969286.0, 'created_time': 1774378378.307814, 'last_price_update_time': 1774855898.257293}
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG29353') HTTP/1.1" 204 0
2026-03-30 07:31:38 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ85703%27 HTTP/1.1" 200 None
2026-03-30 07:31:38 [auto1.de] INFO: Scrape type for TZ85703: 1
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg not downloaded yet
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL25278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF16052> (referer: https://www.auto1.com/v1/car-details-view/VF16052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK26573> (referer: https://www.auto1.com/v1/car-details-view/BK26573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc908650>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c0650>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc54f390>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c0090>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_ea343fc93eb22b6b1d939aa012892d61.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_ea343fc93eb22b6b1d939aa012892d61.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4ec2d0>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_40aee32a299e8507eed47c1a639e60b3.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_40aee32a299e8507eed47c1a639e60b3.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:38 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR86054%27 HTTP/1.1" 200 None
2026-03-30 07:31:38 [auto1.de] INFO: Scrape type for UR86054: 1
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_79c7c1629b3e021d36a3936f5b092286.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_79c7c1629b3e021d36a3936f5b092286.jpg not downloaded yet
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD75815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB70642> (referer: https://www.auto1.com/v1/car-details-view/DB70642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ50570> (referer: https://www.auto1.com/v1/car-details-view/GJ50570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc57e3d0>
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg saved to cache
2026-03-30 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:39 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 07:31:39 [auto1.de] INFO: Found listing with ID: RX59443
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX59443%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [auto1.de] INFO: Scrape type for RX59443: 2
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with identifier: RX59443
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with scrape type 2
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with scrape type 2
2026-03-30 07:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7892577f-426f-57f4-b7ef-1e0dac5f2d2a, identifier: RX59443
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_c219f6acf3e88af56fe5defb15e6a432.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_c219f6acf3e88af56fe5defb15e6a432.jpg not downloaded yet
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with identifier: VF16052
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with scrape type 1
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_28515157a8589c8cf9ca701095fc031f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_28515157a8589c8cf9ca701095fc031f.jpg not downloaded yet
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with identifier: BK26573
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with scrape type 1
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_c6963702282be7f13eacff4479092bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_c6963702282be7f13eacff4479092bf9.jpg not downloaded yet
2026-03-30 07:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with identifier: RX59443
2026-03-30 07:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with identifier: RX59443
2026-03-30 07:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7892577f-426f-57f4-b7ef-1e0dac5f2d2a with identifier: RX59443 to the API
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:39:58Z',
 'fuel_type': 'petrol',
 'id': '7892577f-426f-57f4-b7ef-1e0dac5f2d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX59443',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 68137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX59443%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [auto1.de] INFO: Saving data for RX59443: {'auction_closing_time': 1774971598.0, 'created_time': 1773305851.501908, 'last_price_update_time': 1774855899.580594}
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX59443') HTTP/1.1" 204 0
2026-03-30 07:31:39 [auto1.de] INFO: Found listing with ID: UB75058
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB75058%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [auto1.de] INFO: Scrape type for UB75058: 2
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with identifier: UB75058
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with scrape type 2
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with scrape type 2
2026-03-30 07:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f17fc4e8-d40e-56ed-98d2-2cb2e3f42509, identifier: UB75058
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg not downloaded yet
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_4589e9adfe250abaa450c743f108e86b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_4589e9adfe250abaa450c743f108e86b.jpg not downloaded yet
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_68f99470c1823a587d7af8007bcfd3ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_68f99470c1823a587d7af8007bcfd3ed.jpg not downloaded yet
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2ef6ef-e0e1-5d0c-823b-85566266755f with identifier: DB70642
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f with scrape type 1
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg not downloaded yet
2026-03-30 07:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7643e662-76f0-5777-a420-4e2f5b2956ef with identifier: GJ50570
2026-03-30 07:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7643e662-76f0-5777-a420-4e2f5b2956ef with scrape type 1
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_4868aaedb32fca7edaadcfb297650d02.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_4868aaedb32fca7edaadcfb297650d02.jpg not downloaded yet
2026-03-30 07:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with identifier: UB75058
2026-03-30 07:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with identifier: UB75058
2026-03-30 07:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f17fc4e8-d40e-56ed-98d2-2cb2e3f42509 with identifier: UB75058 to the API
2026-03-30 07:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:28:20Z',
 'fuel_type': 'petrol',
 'id': 'f17fc4e8-d40e-56ed-98d2-2cb2e3f42509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB75058',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Celerio',
 'odometer': 107918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Suzuki Celerio 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2018}
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB75058%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [auto1.de] INFO: Saving data for UB75058: {'auction_closing_time': 1774970900.0, 'created_time': 1773686616.968422, 'last_price_update_time': 1774855900.186127}
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB75058') HTTP/1.1" 204 0
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_13d545a8248ef8581b96da307df7d9ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81af1e87d9ad7d21a8e19eda19276749.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: TE16173
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: SC19124
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: YT41914
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: SV96004
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: CF37997
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF37997%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [auto1.de] INFO: Scrape type for CF37997: 1
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_a13d3c9d92ebfbca9792704678a7c187.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_a13d3c9d92ebfbca9792704678a7c187.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_828eca6a7c03dc47839956201f5f05bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_828eca6a7c03dc47839956201f5f05bc.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_6c49eef4a776be1a1a657504243b13f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_6c49eef4a776be1a1a657504243b13f3.jpg not downloaded yet
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_79c7c1629b3e021d36a3936f5b092286.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81f425e1003f3353eedda58878780d44.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_699b193a9ebe263b6721d162a48ef530.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: FA11917
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA11917%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [auto1.de] INFO: Scrape type for FA11917: 2
2026-03-30 07:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with identifier: FA11917
2026-03-30 07:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with scrape type 2
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with scrape type 2
2026-03-30 07:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dfdf21b-d7bd-5164-9600-19c24d2a1981, identifier: FA11917
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_b46c25e775125db6dc4b53e889d351e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b46c25e775125db6dc4b53e889d351e7.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg not downloaded yet
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_8115e33a6896aa18cb05363b33184ceb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_8115e33a6896aa18cb05363b33184ceb.jpg not downloaded yet
2026-03-30 07:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with identifier: FA11917
2026-03-30 07:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with identifier: FA11917
2026-03-30 07:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dfdf21b-d7bd-5164-9600-19c24d2a1981 with identifier: FA11917 to the API
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:06Z',
 'fuel_type': 'diesel',
 'id': '9dfdf21b-d7bd-5164-9600-19c24d2a1981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA11917',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 117577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Vision",
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2019}
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA11917%27 HTTP/1.1" 200 None
2026-03-30 07:31:40 [auto1.de] INFO: Saving data for FA11917: {'auction_closing_time': 1774972266.0, 'created_time': 1774262600.119875, 'last_price_update_time': 1774855900.877364}
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA11917') HTTP/1.1" 204 0
2026-03-30 07:31:40 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX58927%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [auto1.de] INFO: Scrape type for DX58927: 2
2026-03-30 07:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 712b2060-d342-557b-80c3-26fd348af05c with identifier: DX58927
2026-03-30 07:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 712b2060-d342-557b-80c3-26fd348af05c with scrape type 2
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 712b2060-d342-557b-80c3-26fd348af05c with scrape type 2
2026-03-30 07:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 712b2060-d342-557b-80c3-26fd348af05c, identifier: DX58927
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_d02f6f9417ee544cc1132510171256a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_d02f6f9417ee544cc1132510171256a2.jpg not downloaded yet
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_adff3d3513f33d288cbdd358c9caed2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_adff3d3513f33d288cbdd358c9caed2e.jpg not downloaded yet
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_7857a453f92ce0aabf2b60d304a045c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_7857a453f92ce0aabf2b60d304a045c4.jpg not downloaded yet
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg not downloaded yet
2026-03-30 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_68f99470c1823a587d7af8007bcfd3ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_4589e9adfe250abaa450c743f108e86b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_c0bc303efc0f703deac0e06cfeab193d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_afcbc7f3c3b825c846417fed7e448c10.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 712b2060-d342-557b-80c3-26fd348af05c with identifier: DX58927
2026-03-30 07:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 712b2060-d342-557b-80c3-26fd348af05c with identifier: DX58927
2026-03-30 07:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 712b2060-d342-557b-80c3-26fd348af05c with identifier: DX58927 to the API
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:28:35Z',
 'fuel_type': 'diesel',
 'id': '712b2060-d342-557b-80c3-26fd348af05c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX58927',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 137738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX58927%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [auto1.de] INFO: Saving data for DX58927: {'auction_closing_time': 1774970915.0, 'created_time': 1774377424.309101, 'last_price_update_time': 1774855901.530624}
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX58927') HTTP/1.1" 204 0
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca59550>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_13d545a8248ef8581b96da307df7d9ac.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_13d545a8248ef8581b96da307df7d9ac.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4769d0>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_81af1e87d9ad7d21a8e19eda19276749.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81af1e87d9ad7d21a8e19eda19276749.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7f5f10>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4f3210>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_79c7c1629b3e021d36a3936f5b092286.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_79c7c1629b3e021d36a3936f5b092286.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc862190>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_81f425e1003f3353eedda58878780d44.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81f425e1003f3353eedda58878780d44.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7f4550>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_699b193a9ebe263b6721d162a48ef530.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_699b193a9ebe263b6721d162a48ef530.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc5675d0>
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg saved to cache
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:41 [auto1.de] INFO: Found listing with ID: XD63498
2026-03-30 07:31:41 [auto1.de] INFO: Found listing with ID: JB86449
2026-03-30 07:31:41 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35762%27 HTTP/1.1" 200 None
2026-03-30 07:31:41 [auto1.de] INFO: Scrape type for WP35762: 2
2026-03-30 07:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641e7a69-7f36-54c0-ab93-bd436b80ed1f with identifier: WP35762
2026-03-30 07:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641e7a69-7f36-54c0-ab93-bd436b80ed1f with scrape type 2
2026-03-30 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 641e7a69-7f36-54c0-ab93-bd436b80ed1f with scrape type 2
2026-03-30 07:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 641e7a69-7f36-54c0-ab93-bd436b80ed1f, identifier: WP35762
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_72c9dccff654217cf43f4d74ce49aca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_72c9dccff654217cf43f4d74ce49aca1.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_042a0b739ab4ef02deea38d818f7d735.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_042a0b739ab4ef02deea38d818f7d735.jpg not downloaded yet
2026-03-30 07:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 641e7a69-7f36-54c0-ab93-bd436b80ed1f with identifier: WP35762
2026-03-30 07:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 641e7a69-7f36-54c0-ab93-bd436b80ed1f with identifier: WP35762
2026-03-30 07:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 641e7a69-7f36-54c0-ab93-bd436b80ed1f with identifier: WP35762 to the API
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:11:47Z',
 'fuel_type': 'diesel',
 'id': '641e7a69-7f36-54c0-ab93-bd436b80ed1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP35762',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35762%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [auto1.de] INFO: Saving data for WP35762: {'auction_closing_time': 1774969907.0, 'created_time': 1774378023.928549, 'last_price_update_time': 1774855902.510325}
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP35762') HTTP/1.1" 204 0
2026-03-30 07:31:42 [auto1.de] INFO: Found listing with ID: UZ06003
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ06003%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [auto1.de] INFO: Scrape type for UZ06003: 1
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_b5414d4950d2d22551da4c5578cff95b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_b5414d4950d2d22551da4c5578cff95b.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_c912482c8b431f02f54148ea0d013fa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_c912482c8b431f02f54148ea0d013fa1.jpg not downloaded yet
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc861c90>
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_68f99470c1823a587d7af8007bcfd3ed.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_68f99470c1823a587d7af8007bcfd3ed.jpg saved to cache
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4539d0>
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_4589e9adfe250abaa450c743f108e86b.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_4589e9adfe250abaa450c743f108e86b.jpg saved to cache
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc972850>
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_c0bc303efc0f703deac0e06cfeab193d.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_c0bc303efc0f703deac0e06cfeab193d.jpg saved to cache
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc90ba50>
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_afcbc7f3c3b825c846417fed7e448c10.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_afcbc7f3c3b825c846417fed7e448c10.jpg saved to cache
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b46c25e775125db6dc4b53e889d351e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF77211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_8115e33a6896aa18cb05363b33184ceb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:42 [auto1.de] INFO: Found listing with ID: FU96820
2026-03-30 07:31:42 [auto1.de] INFO: Found listing with ID: LZ51048
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51048%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [auto1.de] INFO: Scrape type for LZ51048: 2
2026-03-30 07:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec5b2851-7114-56cd-85c4-ec6774275513 with identifier: LZ51048
2026-03-30 07:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec5b2851-7114-56cd-85c4-ec6774275513 with scrape type 2
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec5b2851-7114-56cd-85c4-ec6774275513 with scrape type 2
2026-03-30 07:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec5b2851-7114-56cd-85c4-ec6774275513, identifier: LZ51048
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_bb84ad5c21951e9d650f17b81b490bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_bb84ad5c21951e9d650f17b81b490bde.jpg not downloaded yet
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg not downloaded yet
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_1ef161329ceb6580fde7c02d61c61929.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_1ef161329ceb6580fde7c02d61c61929.jpg not downloaded yet
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg not downloaded yet
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR86054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ85703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN21197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD88298> (referer: https://www.auto1.com/v1/car-details-view/KD88298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE43577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca3d910>
2026-03-30 07:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg saved to cache
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec5b2851-7114-56cd-85c4-ec6774275513 with identifier: LZ51048
2026-03-30 07:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec5b2851-7114-56cd-85c4-ec6774275513 with identifier: LZ51048
2026-03-30 07:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec5b2851-7114-56cd-85c4-ec6774275513 with identifier: LZ51048 to the API
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:53:04Z',
 'fuel_type': 'petrol',
 'id': 'ec5b2851-7114-56cd-85c4-ec6774275513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51048',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 111890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-12',
 'seller_name': None,
 'title': 'Audi A3 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51048%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [auto1.de] INFO: Saving data for LZ51048: {'auction_closing_time': 1774972384.0, 'created_time': 1773774805.885549, 'last_price_update_time': 1774855903.438897}
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ51048') HTTP/1.1" 204 0
2026-03-30 07:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:43 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [auto1.de] INFO: Scrape type for CS88634: 2
2026-03-30 07:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with identifier: CS88634
2026-03-30 07:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with scrape type 2
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with scrape type 2
2026-03-30 07:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fb6ef7d-efd5-547f-bd48-f8526ac5d079, identifier: CS88634
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_2991b791fd6c946ce04677845ae78cd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2991b791fd6c946ce04677845ae78cd1.jpg not downloaded yet
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_b393571a6cde3cc6b7feafb08ad11041.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b393571a6cde3cc6b7feafb08ad11041.jpg not downloaded yet
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg not downloaded yet
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_5148b4d077636be1a09369ce36f36582.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_5148b4d077636be1a09369ce36f36582.jpg not downloaded yet
2026-03-30 07:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with identifier: CS88634
2026-03-30 07:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with identifier: CS88634
2026-03-30 07:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fb6ef7d-efd5-547f-bd48-f8526ac5d079 with identifier: CS88634 to the API
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:25:12Z',
 'fuel_type': 'petrol',
 'id': '8fb6ef7d-efd5-547f-bd48-f8526ac5d079',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS88634',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 168947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [auto1.de] INFO: Saving data for CS88634: {'auction_closing_time': 1774970712.0, 'created_time': 1773945354.71287, 'last_price_update_time': 1774855904.020903}
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS88634') HTTP/1.1" 204 0
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6c2390>
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_b46c25e775125db6dc4b53e889d351e7.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b46c25e775125db6dc4b53e889d351e7.jpg saved to cache
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc752210>
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg saved to cache
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4b22d0>
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_8115e33a6896aa18cb05363b33184ceb.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_8115e33a6896aa18cb05363b33184ceb.jpg saved to cache
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_c912482c8b431f02f54148ea0d013fa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:44 [auto1.de] INFO: Found listing with ID: VV53605
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV53605%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [auto1.de] INFO: Scrape type for VV53605: 2
2026-03-30 07:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9ffc53-6735-5085-a93a-686404f6f084 with identifier: VV53605
2026-03-30 07:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9ffc53-6735-5085-a93a-686404f6f084 with scrape type 2
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9ffc53-6735-5085-a93a-686404f6f084 with scrape type 2
2026-03-30 07:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c9ffc53-6735-5085-a93a-686404f6f084, identifier: VV53605
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_f08cce9b34c39740289660b31eadbce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_f08cce9b34c39740289660b31eadbce9.jpg not downloaded yet
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_23997bc643a171b26602eaf986d3cdef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_23997bc643a171b26602eaf986d3cdef.jpg not downloaded yet
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_4e873d7848886a4cc382c973a780eb4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_4e873d7848886a4cc382c973a780eb4f.jpg not downloaded yet
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg not downloaded yet
2026-03-30 07:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD75815> (referer: https://www.auto1.com/v1/car-details-view/HD75815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c9ffc53-6735-5085-a93a-686404f6f084 with identifier: VV53605
2026-03-30 07:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c9ffc53-6735-5085-a93a-686404f6f084 with identifier: VV53605
2026-03-30 07:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c9ffc53-6735-5085-a93a-686404f6f084 with identifier: VV53605 to the API
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:08:59Z',
 'fuel_type': 'petrol',
 'id': '8c9ffc53-6735-5085-a93a-686404f6f084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV53605',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 103933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV53605%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [auto1.de] INFO: Saving data for VV53605: {'auction_closing_time': 1774969739.0, 'created_time': 1774292608.746167, 'last_price_update_time': 1774855904.738479}
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV53605') HTTP/1.1" 204 0
2026-03-30 07:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:44 [auto1.de] INFO: Found listing with ID: YS60575
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS60575%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [auto1.de] INFO: Scrape type for YS60575: 2
2026-03-30 07:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db91129e-b4e4-5150-9359-701ff1a52a28 with identifier: YS60575
2026-03-30 07:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db91129e-b4e4-5150-9359-701ff1a52a28 with scrape type 2
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db91129e-b4e4-5150-9359-701ff1a52a28 with scrape type 2
2026-03-30 07:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db91129e-b4e4-5150-9359-701ff1a52a28, identifier: YS60575
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg not downloaded yet
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_122217e510b04b9e74b5a1d2bce36318.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_122217e510b04b9e74b5a1d2bce36318.jpg not downloaded yet
2026-03-30 07:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed01db8-77d2-5cea-ba72-e54bc1989527 with identifier: KD88298
2026-03-30 07:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed01db8-77d2-5cea-ba72-e54bc1989527 with scrape type 1
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ed01db8-77d2-5cea-ba72-e54bc1989527
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_8d641464e5b6fdc53419b714439c9465.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_8d641464e5b6fdc53419b714439c9465.jpg already downloaded
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_a47e0781a3504810e7109e40057b9842.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a47e0781a3504810e7109e40057b9842.jpg already downloaded
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_acd3c50fd9a329e689fdfd6d8fe8d6b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acd3c50fd9a329e689fdfd6d8fe8d6b3.jpg already downloaded
2026-03-30 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_104d596f2e3128f55c73be7fa5fbcc33.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_104d596f2e3128f55c73be7fa5fbcc33.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_ab5acf01b88613b9e8f609316cc6eece.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ab5acf01b88613b9e8f609316cc6eece.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_a73dea1bacd23a5a58a54e046d857deb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a73dea1bacd23a5a58a54e046d857deb.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_acec357111216f39ee590b70685967c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acec357111216f39ee590b70685967c2.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_ef53c4bc558dc0f90e7fb319a77a8437.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ef53c4bc558dc0f90e7fb319a77a8437.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_5381cafa896c2957fb3fcbca4a9e1d8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_5381cafa896c2957fb3fcbca4a9e1d8d.jpg already downloaded
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6a%252F5f6afcc3cb798b374b84c463d3675d2f%252Fpa%252FKD88298_f98a1ca0723beba0c537e278042c87da.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_f98a1ca0723beba0c537e278042c87da.jpg already downloaded
2026-03-30 07:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ed01db8-77d2-5cea-ba72-e54bc1989527, identifier: KD88298
2026-03-30 07:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bf034850>
2026-03-30 07:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg saved to cache
2026-03-30 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db91129e-b4e4-5150-9359-701ff1a52a28 with identifier: YS60575
2026-03-30 07:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db91129e-b4e4-5150-9359-701ff1a52a28 with identifier: YS60575
2026-03-30 07:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db91129e-b4e4-5150-9359-701ff1a52a28 with identifier: YS60575 to the API
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:17:09Z',
 'fuel_type': 'diesel',
 'id': 'db91129e-b4e4-5150-9359-701ff1a52a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS60575',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 228785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Innovation',
 'transmission': 'automatic',
 'trim': 'Business Innovation',
 'year': 2015}
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS60575%27 HTTP/1.1" 200 None
2026-03-30 07:31:45 [auto1.de] INFO: Saving data for YS60575: {'auction_closing_time': 1774970229.0, 'created_time': 1773484367.859201, 'last_price_update_time': 1774855905.756426}
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS60575') HTTP/1.1" 204 0
2026-03-30 07:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ed01db8-77d2-5cea-ba72-e54bc1989527 with identifier: KD88298
2026-03-30 07:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ed01db8-77d2-5cea-ba72-e54bc1989527 with identifier: KD88298
2026-03-30 07:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ed01db8-77d2-5cea-ba72-e54bc1989527 with identifier: KD88298 to the API
2026-03-30 07:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD88298>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:18:11Z',
 'fuel_type': 'diesel',
 'id': '4ed01db8-77d2-5cea-ba72-e54bc1989527',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD88298',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 184219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_8d641464e5b6fdc53419b714439c9465.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a47e0781a3504810e7109e40057b9842.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acd3c50fd9a329e689fdfd6d8fe8d6b3.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_104d596f2e3128f55c73be7fa5fbcc33.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ab5acf01b88613b9e8f609316cc6eece.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a73dea1bacd23a5a58a54e046d857deb.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acec357111216f39ee590b70685967c2.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ef53c4bc558dc0f90e7fb319a77a8437.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_5381cafa896c2957fb3fcbca4a9e1d8d.jpg',
                'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_f98a1ca0723beba0c537e278042c87da.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_8d641464e5b6fdc53419b714439c9465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a47e0781a3504810e7109e40057b9842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acd3c50fd9a329e689fdfd6d8fe8d6b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_104d596f2e3128f55c73be7fa5fbcc33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ab5acf01b88613b9e8f609316cc6eece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_a73dea1bacd23a5a58a54e046d857deb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_acec357111216f39ee590b70685967c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_ef53c4bc558dc0f90e7fb319a77a8437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_5381cafa896c2957fb3fcbca4a9e1d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed01db8-77d2-5cea-ba72-e54bc1989527/4ed01db8-77d2-5cea-ba72-e54bc1989527_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6a/5f6afcc3cb798b374b84c463d3675d2f/pa/KD88298_f98a1ca0723beba0c537e278042c87da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2019}
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD88298%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [auto1.de] INFO: Saving data for KD88298: {'created_time': 1774855906.134836, 'last_price_update_time': 1774855906.13485, 'auction_closing_time': 1774970291.0}
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD88298') HTTP/1.1" 204 0
2026-03-30 07:31:46 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 07:31:46 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG33425%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [auto1.de] INFO: Scrape type for DG33425: 1
2026-03-30 07:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc9035d0>
2026-03-30 07:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_c912482c8b431f02f54148ea0d013fa1.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_c912482c8b431f02f54148ea0d013fa1.jpg saved to cache
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac with identifier: HD75815
2026-03-30 07:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac with scrape type 1
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_172166f20ab7a153f0ac8fff107456ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_172166f20ab7a153f0ac8fff107456ee.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_6f8ca47b18be4240f8b952f06513bf62.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f8ca47b18be4240f8b952f06513bf62.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_d89ca1a3d298a4004eda4d0d7fb88655.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_d89ca1a3d298a4004eda4d0d7fb88655.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_6f3f5798fbe1a1158c0bb2d6d96c6353.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f3f5798fbe1a1158c0bb2d6d96c6353.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_cae46733ee8a7df0e8da347556b38a58.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_cae46733ee8a7df0e8da347556b38a58.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_75e89b5559b128b837c58c38178c4396.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_75e89b5559b128b837c58c38178c4396.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_717fefd0d65728321223e6ea0407005c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_717fefd0d65728321223e6ea0407005c.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_592c003931f6a191c0862bcb18019563.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_592c003931f6a191c0862bcb18019563.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_974bd82c2f0ac0d0701fe9c2a30ad572.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_974bd82c2f0ac0d0701fe9c2a30ad572.jpg already downloaded
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe5%252Fcde55b7f9bc91b71ce2e848fdf5379a4%252Fpa%252FHD75815_3460abef2e4f65347180ade99ae614d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_3460abef2e4f65347180ade99ae614d6.jpg already downloaded
2026-03-30 07:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac, identifier: HD75815
2026-03-30 07:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_042a0b739ab4ef02deea38d818f7d735.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac with identifier: HD75815
2026-03-30 07:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac with identifier: HD75815
2026-03-30 07:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db83a5b-b982-5d2d-b6c4-30dc673fc1ac with identifier: HD75815 to the API
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HD75815>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:42:27Z',
 'fuel_type': 'diesel',
 'id': '4db83a5b-b982-5d2d-b6c4-30dc673fc1ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD75815',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 274951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_172166f20ab7a153f0ac8fff107456ee.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f8ca47b18be4240f8b952f06513bf62.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_d89ca1a3d298a4004eda4d0d7fb88655.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f3f5798fbe1a1158c0bb2d6d96c6353.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_cae46733ee8a7df0e8da347556b38a58.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_75e89b5559b128b837c58c38178c4396.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_717fefd0d65728321223e6ea0407005c.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_592c003931f6a191c0862bcb18019563.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_974bd82c2f0ac0d0701fe9c2a30ad572.jpg',
                'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_3460abef2e4f65347180ade99ae614d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_172166f20ab7a153f0ac8fff107456ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f8ca47b18be4240f8b952f06513bf62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_d89ca1a3d298a4004eda4d0d7fb88655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_6f3f5798fbe1a1158c0bb2d6d96c6353.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_cae46733ee8a7df0e8da347556b38a58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_75e89b5559b128b837c58c38178c4396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_717fefd0d65728321223e6ea0407005c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_592c003931f6a191c0862bcb18019563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_974bd82c2f0ac0d0701fe9c2a30ad572.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db83a5b-b982-5d2d-b6c4-30dc673fc1ac/4db83a5b-b982-5d2d-b6c4-30dc673fc1ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e5/cde55b7f9bc91b71ce2e848fdf5379a4/pa/HD75815_3460abef2e4f65347180ade99ae614d6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-06',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2013}
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75815%27 HTTP/1.1" 200 None
2026-03-30 07:31:46 [auto1.de] INFO: Saving data for HD75815: {'created_time': 1774855906.913019, 'last_price_update_time': 1774855906.913031, 'auction_closing_time': 1774971747.0}
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD75815') HTTP/1.1" 204 0
2026-03-30 07:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc578150>
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg saved to cache
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc89aad0>
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg saved to cache
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_72c9dccff654217cf43f4d74ce49aca1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:47 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD75642%27 HTTP/1.1" 200 None
2026-03-30 07:31:47 [auto1.de] INFO: Scrape type for GD75642: 2
2026-03-30 07:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d339bc9b-4b50-51df-ad91-f9a579824387 with identifier: GD75642
2026-03-30 07:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d339bc9b-4b50-51df-ad91-f9a579824387 with scrape type 2
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d339bc9b-4b50-51df-ad91-f9a579824387 with scrape type 2
2026-03-30 07:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d339bc9b-4b50-51df-ad91-f9a579824387, identifier: GD75642
2026-03-30 07:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d339bc9b-4b50-51df-ad91-f9a579824387 with identifier: GD75642
2026-03-30 07:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d339bc9b-4b50-51df-ad91-f9a579824387 with identifier: GD75642
2026-03-30 07:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d339bc9b-4b50-51df-ad91-f9a579824387 with identifier: GD75642 to the API
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:02:34Z',
 'fuel_type': 'petrol',
 'id': 'd339bc9b-4b50-51df-ad91-f9a579824387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD75642',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 149418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD75642%27 HTTP/1.1" 200 None
2026-03-30 07:31:47 [auto1.de] INFO: Saving data for GD75642: {'auction_closing_time': 1774969354.0, 'created_time': 1773305290.768693, 'last_price_update_time': 1774855907.916328}
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD75642') HTTP/1.1" 204 0
2026-03-30 07:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc524810>
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg saved to cache
2026-03-30 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:47 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45885%27 HTTP/1.1" 200 None
2026-03-30 07:31:48 [auto1.de] INFO: Scrape type for DB45885: 1
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be874e50>
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_042a0b739ab4ef02deea38d818f7d735.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_042a0b739ab4ef02deea38d818f7d735.jpg saved to cache
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc432810>
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_72c9dccff654217cf43f4d74ce49aca1.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_72c9dccff654217cf43f4d74ce49aca1.jpg saved to cache
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:48 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 07:31:48 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 07:31:48 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 07:31:48 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79553%27 HTTP/1.1" 200 None
2026-03-30 07:31:48 [auto1.de] INFO: Scrape type for JE79553: 2
2026-03-30 07:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b785a11a-e082-5758-89ed-74ed874fd499 with identifier: JE79553
2026-03-30 07:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b785a11a-e082-5758-89ed-74ed874fd499 with scrape type 2
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b785a11a-e082-5758-89ed-74ed874fd499 with scrape type 2
2026-03-30 07:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b785a11a-e082-5758-89ed-74ed874fd499, identifier: JE79553
2026-03-30 07:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b785a11a-e082-5758-89ed-74ed874fd499 with identifier: JE79553
2026-03-30 07:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b785a11a-e082-5758-89ed-74ed874fd499 with identifier: JE79553
2026-03-30 07:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b785a11a-e082-5758-89ed-74ed874fd499 with identifier: JE79553 to the API
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:19:18Z',
 'fuel_type': 'diesel',
 'id': 'b785a11a-e082-5758-89ed-74ed874fd499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE79553',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 246580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79553%27 HTTP/1.1" 200 None
2026-03-30 07:31:48 [auto1.de] INFO: Saving data for JE79553: {'auction_closing_time': 1774970358.0, 'created_time': 1773484407.099367, 'last_price_update_time': 1774855908.624171}
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE79553') HTTP/1.1" 204 0
2026-03-30 07:31:48 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM55241%27 HTTP/1.1" 200 None
2026-03-30 07:31:48 [auto1.de] INFO: Scrape type for LM55241: 2
2026-03-30 07:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with identifier: LM55241
2026-03-30 07:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with scrape type 2
2026-03-30 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with scrape type 2
2026-03-30 07:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da, identifier: LM55241
2026-03-30 07:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with identifier: LM55241
2026-03-30 07:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with identifier: LM55241
2026-03-30 07:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d6bed2d-0563-5e1b-8ab4-af2685d6d6da with identifier: LM55241 to the API
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:22:14Z',
 'fuel_type': 'petrol',
 'id': '5d6bed2d-0563-5e1b-8ab4-af2685d6d6da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM55241',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM55241%27 HTTP/1.1" 200 None
2026-03-30 07:31:49 [auto1.de] INFO: Saving data for LM55241: {'auction_closing_time': 1774970534.0, 'created_time': 1774291996.80723, 'last_price_update_time': 1774855909.099215}
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM55241') HTTP/1.1" 204 0
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_5148b4d077636be1a09369ce36f36582.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 07:31:49 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6ab810>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7aaed0>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_c6963702282be7f13eacff4479092bf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8f4590>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_5148b4d077636be1a09369ce36f36582.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_5148b4d077636be1a09369ce36f36582.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_23997bc643a171b26602eaf986d3cdef.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_4868aaedb32fca7edaadcfb297650d02.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc692bd0>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_f08cce9b34c39740289660b31eadbce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_b5414d4950d2d22551da4c5578cff95b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6aaf10>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_c6963702282be7f13eacff4479092bf9.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_c6963702282be7f13eacff4479092bf9.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beb10310>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_23997bc643a171b26602eaf986d3cdef.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_23997bc643a171b26602eaf986d3cdef.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b0e10>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_4868aaedb32fca7edaadcfb297650d02.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_4868aaedb32fca7edaadcfb297650d02.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca5a6d0>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg saved to cache
2026-03-30 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_122217e510b04b9e74b5a1d2bce36318.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE43577> (referer: https://www.auto1.com/v1/car-details-view/AE43577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8d11d0>
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_f08cce9b34c39740289660b31eadbce9.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_f08cce9b34c39740289660b31eadbce9.jpg saved to cache
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc452e90>
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg saved to cache
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b0f90>
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_b5414d4950d2d22551da4c5578cff95b.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_b5414d4950d2d22551da4c5578cff95b.jpg saved to cache
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b0a50>
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg saved to cache
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG33425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN21197> (referer: https://www.auto1.com/v1/car-details-view/PN21197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc432f10>
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_122217e510b04b9e74b5a1d2bce36318.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_122217e510b04b9e74b5a1d2bce36318.jpg saved to cache
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd97994-d387-57df-9567-3e51bb7c8712 with identifier: AE43577
2026-03-30 07:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd97994-d387-57df-9567-3e51bb7c8712 with scrape type 1
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cd97994-d387-57df-9567-3e51bb7c8712
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_4c63a1d0d1b837acf4482cc3bd11431b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_4c63a1d0d1b837acf4482cc3bd11431b.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_e79e7694f65209be2cbca4e21fa85261.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e79e7694f65209be2cbca4e21fa85261.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_e4f1ffc8ccf953b6ed17fb9639c4b638.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e4f1ffc8ccf953b6ed17fb9639c4b638.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_ffbfdd9a6005184939ce4bb18fb4589e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ffbfdd9a6005184939ce4bb18fb4589e.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_b02099935b6d1b52ebe04253ef8d9e2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_b02099935b6d1b52ebe04253ef8d9e2d.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_78c9283dc6ee947e05f3beeabbee6c3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_78c9283dc6ee947e05f3beeabbee6c3f.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_fe39c2ced17c2e9cd469c9867eedf4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_fe39c2ced17c2e9cd469c9867eedf4ed.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_ec5f5e2248fa1f8d95826aad396fd603.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ec5f5e2248fa1f8d95826aad396fd603.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_69da5b72a6c4c365341291c00869f973.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_69da5b72a6c4c365341291c00869f973.jpg already downloaded
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F86%252F7e86c916bfc8b1c5ef4069bcf3e305e4%252Fpa%252FAE43577_260119f27a03525c843e03764aaebd09.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_260119f27a03525c843e03764aaebd09.jpg already downloaded
2026-03-30 07:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cd97994-d387-57df-9567-3e51bb7c8712, identifier: AE43577
2026-03-30 07:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cd97994-d387-57df-9567-3e51bb7c8712 with identifier: AE43577
2026-03-30 07:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cd97994-d387-57df-9567-3e51bb7c8712 with identifier: AE43577
2026-03-30 07:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cd97994-d387-57df-9567-3e51bb7c8712 with identifier: AE43577 to the API
2026-03-30 07:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE43577>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:23:29Z',
 'fuel_type': 'diesel',
 'id': '2cd97994-d387-57df-9567-3e51bb7c8712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE43577',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'GL-Klasse',
 'odometer': 159481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_4c63a1d0d1b837acf4482cc3bd11431b.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e79e7694f65209be2cbca4e21fa85261.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e4f1ffc8ccf953b6ed17fb9639c4b638.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ffbfdd9a6005184939ce4bb18fb4589e.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_b02099935b6d1b52ebe04253ef8d9e2d.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_78c9283dc6ee947e05f3beeabbee6c3f.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_fe39c2ced17c2e9cd469c9867eedf4ed.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ec5f5e2248fa1f8d95826aad396fd603.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_69da5b72a6c4c365341291c00869f973.jpg',
                'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_260119f27a03525c843e03764aaebd09.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2956467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_4c63a1d0d1b837acf4482cc3bd11431b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e79e7694f65209be2cbca4e21fa85261.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_e4f1ffc8ccf953b6ed17fb9639c4b638.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ffbfdd9a6005184939ce4bb18fb4589e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_b02099935b6d1b52ebe04253ef8d9e2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_78c9283dc6ee947e05f3beeabbee6c3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2175794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_fe39c2ced17c2e9cd469c9867eedf4ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_ec5f5e2248fa1f8d95826aad396fd603.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2969257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_69da5b72a6c4c365341291c00869f973.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd97994-d387-57df-9567-3e51bb7c8712/2cd97994-d387-57df-9567-3e51bb7c8712_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/86/7e86c916bfc8b1c5ef4069bcf3e305e4/pa/AE43577_260119f27a03525c843e03764aaebd09.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GL-Klasse GL 350 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE43577%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [auto1.de] INFO: Saving data for AE43577: {'created_time': 1774855911.145049, 'last_price_update_time': 1774855911.14506, 'auction_closing_time': 1774970609.0}
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE43577') HTTP/1.1" 204 0
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b393571a6cde3cc6b7feafb08ad11041.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB45885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2991b791fd6c946ce04677845ae78cd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_bb84ad5c21951e9d650f17b81b490bde.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR86054> (referer: https://www.auto1.com/v1/car-details-view/UR86054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF77211> (referer: https://www.auto1.com/v1/car-details-view/BF77211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ85703> (referer: https://www.auto1.com/v1/car-details-view/TZ85703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca96b10>
2026-03-30 07:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg saved to cache
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab4f398-a388-5277-9a73-1553219d9973 with identifier: PN21197
2026-03-30 07:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab4f398-a388-5277-9a73-1553219d9973 with scrape type 1
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ab4f398-a388-5277-9a73-1553219d9973
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_c6457c85d4ce76c0a4466c33888e56b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c6457c85d4ce76c0a4466c33888e56b4.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_e2d6919d27e926fe80f378da4369ffe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_e2d6919d27e926fe80f378da4369ffe4.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_30fff0abb4f41228ae8443b2808e4847.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_30fff0abb4f41228ae8443b2808e4847.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_256a5a31c2dec4f7a4019c1568664797.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_256a5a31c2dec4f7a4019c1568664797.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_c18b920199fc05b4125108b0759cf5bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c18b920199fc05b4125108b0759cf5bb.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_7c152838c40e442243f46a383727a563.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_7c152838c40e442243f46a383727a563.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_739f58cc89920c5c5da30dee8ed1a015.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_739f58cc89920c5c5da30dee8ed1a015.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_95509977111d7e200d20359a7ec8d14c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_95509977111d7e200d20359a7ec8d14c.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_47039b03e1d3bef8243103884f62211f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_47039b03e1d3bef8243103884f62211f.jpg already downloaded
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F85%252F9285cc941c2881dad94daeb7f6ae3b0e%252Fpa%252FPN21197_156c85292f9b4bed25d71af35abf4442.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_156c85292f9b4bed25d71af35abf4442.jpg already downloaded
2026-03-30 07:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab4f398-a388-5277-9a73-1553219d9973, identifier: PN21197
2026-03-30 07:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab4f398-a388-5277-9a73-1553219d9973 with identifier: PN21197
2026-03-30 07:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab4f398-a388-5277-9a73-1553219d9973 with identifier: PN21197
2026-03-30 07:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab4f398-a388-5277-9a73-1553219d9973 with identifier: PN21197 to the API
2026-03-30 07:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PN21197>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:05:27Z',
 'fuel_type': 'petrol',
 'id': '7ab4f398-a388-5277-9a73-1553219d9973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN21197',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 87685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c6457c85d4ce76c0a4466c33888e56b4.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_e2d6919d27e926fe80f378da4369ffe4.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_30fff0abb4f41228ae8443b2808e4847.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_256a5a31c2dec4f7a4019c1568664797.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c18b920199fc05b4125108b0759cf5bb.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_7c152838c40e442243f46a383727a563.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_739f58cc89920c5c5da30dee8ed1a015.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_95509977111d7e200d20359a7ec8d14c.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_47039b03e1d3bef8243103884f62211f.jpg',
                'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_156c85292f9b4bed25d71af35abf4442.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3122129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c6457c85d4ce76c0a4466c33888e56b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_e2d6919d27e926fe80f378da4369ffe4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_30fff0abb4f41228ae8443b2808e4847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_256a5a31c2dec4f7a4019c1568664797.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_c18b920199fc05b4125108b0759cf5bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3136569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_7c152838c40e442243f46a383727a563.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_739f58cc89920c5c5da30dee8ed1a015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2957995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_95509977111d7e200d20359a7ec8d14c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3160273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_47039b03e1d3bef8243103884f62211f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4f398-a388-5277-9a73-1553219d9973/7ab4f398-a388-5277-9a73-1553219d9973_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/85/9285cc941c2881dad94daeb7f6ae3b0e/pa/PN21197_156c85292f9b4bed25d71af35abf4442.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN21197%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [auto1.de] INFO: Saving data for PN21197: {'created_time': 1774855912.159542, 'last_price_update_time': 1774855912.159553, 'auction_closing_time': 1774969527.0}
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN21197') HTTP/1.1" 204 0
2026-03-30 07:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_adff3d3513f33d288cbdd358c9caed2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_d02f6f9417ee544cc1132510171256a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_6c49eef4a776be1a1a657504243b13f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8c1c50>
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg saved to cache
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc51b850>
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_b393571a6cde3cc6b7feafb08ad11041.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b393571a6cde3cc6b7feafb08ad11041.jpg saved to cache
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc58b890>
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_2991b791fd6c946ce04677845ae78cd1.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2991b791fd6c946ce04677845ae78cd1.jpg saved to cache
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6fdc90>
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_bb84ad5c21951e9d650f17b81b490bde.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_bb84ad5c21951e9d650f17b81b490bde.jpg saved to cache
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44a591e3-297a-53fc-a8b9-b240c3b0a5f1 with identifier: UR86054
2026-03-30 07:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44a591e3-297a-53fc-a8b9-b240c3b0a5f1 with scrape type 1
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 44a591e3-297a-53fc-a8b9-b240c3b0a5f1
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fe9%252F38e9999f51d4611737977b7d7b4f9dbd%252Fpa%252FUR86054_f22663f964f7f4b5d73f2ee859a607ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_f22663f964f7f4b5d73f2ee859a607ab.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fe9%252F38e9999f51d4611737977b7d7b4f9dbd%252Fpa%252FUR86054_4429049922556f241d97dfd2d5b9584f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_4429049922556f241d97dfd2d5b9584f.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fe9%252F38e9999f51d4611737977b7d7b4f9dbd%252Fpa%252FUR86054_effae12ba8a87ff2092a77b98929c68d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_effae12ba8a87ff2092a77b98929c68d.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fe9%252F38e9999f51d4611737977b7d7b4f9dbd%252Fpa%252FUR86054_48da9aeddd08ba827a9d3d40a36a6542.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_48da9aeddd08ba827a9d3d40a36a6542.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fe9%252F38e9999f51d4611737977b7d7b4f9dbd%252Fpa%252FUR86054_c924f87f3e5d332db599a807ea0bacc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_c924f87f3e5d332db599a807ea0bacc1.jpg already downloaded
2026-03-30 07:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44a591e3-297a-53fc-a8b9-b240c3b0a5f1, identifier: UR86054
2026-03-30 07:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7b60a37-5f41-518f-a374-3e34424eff98 with identifier: BF77211
2026-03-30 07:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b60a37-5f41-518f-a374-3e34424eff98 with scrape type 1
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7b60a37-5f41-518f-a374-3e34424eff98
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_eb5d5dac7a4103345977054594146a86.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_eb5d5dac7a4103345977054594146a86.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_8e7ad78faf8aa1db839baf489e783cc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_8e7ad78faf8aa1db839baf489e783cc9.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_4bd565eb0d6350890f5862e68277a6af.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_4bd565eb0d6350890f5862e68277a6af.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_d5ab849f90d5ed02254ea34bd5f6afa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_d5ab849f90d5ed02254ea34bd5f6afa1.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_74d65091926f24f96653ec7e8f9bf59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_74d65091926f24f96653ec7e8f9bf59f.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_5e617067974e41e4d63d8719d1abdfdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_5e617067974e41e4d63d8719d1abdfdc.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_1f132fde73d495275d37fd23d93a2709.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1f132fde73d495275d37fd23d93a2709.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_3a4b42c9c7f06e5a81f0f53ffc28fd8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_3a4b42c9c7f06e5a81f0f53ffc28fd8b.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_943637ccc2bd31c0c8ffa9ec5b14628e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_943637ccc2bd31c0c8ffa9ec5b14628e.jpg already downloaded
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fbb%252Ff8bb447e3a1cb76420f9fbb5cd3c8a84%252Fpa%252FBF77211_1b9cf82d8734f98706dd1550ed8e277e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1b9cf82d8734f98706dd1550ed8e277e.jpg already downloaded
2026-03-30 07:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7b60a37-5f41-518f-a374-3e34424eff98, identifier: BF77211
2026-03-30 07:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5484353f-ec5a-51c7-8166-5d919e65f8d5 with identifier: TZ85703
2026-03-30 07:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5484353f-ec5a-51c7-8166-5d919e65f8d5 with scrape type 1
2026-03-30 07:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg not downloaded yet
2026-03-30 07:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44a591e3-297a-53fc-a8b9-b240c3b0a5f1 with identifier: UR86054
2026-03-30 07:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44a591e3-297a-53fc-a8b9-b240c3b0a5f1 with identifier: UR86054
2026-03-30 07:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44a591e3-297a-53fc-a8b9-b240c3b0a5f1 with identifier: UR86054 to the API
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR86054>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:05:50Z',
 'fuel_type': 'diesel',
 'id': '44a591e3-297a-53fc-a8b9-b240c3b0a5f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR86054',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'BMW',
 'model': '3er',
 'odometer': 303967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_f22663f964f7f4b5d73f2ee859a607ab.jpg',
                'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_4429049922556f241d97dfd2d5b9584f.jpg',
                'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_effae12ba8a87ff2092a77b98929c68d.jpg',
                'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_48da9aeddd08ba827a9d3d40a36a6542.jpg',
                'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_c924f87f3e5d332db599a807ea0bacc1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44a591e3-297a-53fc-a8b9-b240c3b0a5f1/44a591e3-297a-53fc-a8b9-b240c3b0a5f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_f22663f964f7f4b5d73f2ee859a607ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44a591e3-297a-53fc-a8b9-b240c3b0a5f1/44a591e3-297a-53fc-a8b9-b240c3b0a5f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_4429049922556f241d97dfd2d5b9584f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44a591e3-297a-53fc-a8b9-b240c3b0a5f1/44a591e3-297a-53fc-a8b9-b240c3b0a5f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_effae12ba8a87ff2092a77b98929c68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44a591e3-297a-53fc-a8b9-b240c3b0a5f1/44a591e3-297a-53fc-a8b9-b240c3b0a5f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_48da9aeddd08ba827a9d3d40a36a6542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44a591e3-297a-53fc-a8b9-b240c3b0a5f1/44a591e3-297a-53fc-a8b9-b240c3b0a5f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/e9/38e9999f51d4611737977b7d7b4f9dbd/pa/UR86054_c924f87f3e5d332db599a807ea0bacc1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR86054%27 HTTP/1.1" 200 None
2026-03-30 07:31:53 [auto1.de] INFO: Saving data for UR86054: {'created_time': 1774855913.586855, 'last_price_update_time': 1774855913.586868, 'auction_closing_time': 1774969550.0}
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR86054') HTTP/1.1" 204 0
2026-03-30 07:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7b60a37-5f41-518f-a374-3e34424eff98 with identifier: BF77211
2026-03-30 07:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7b60a37-5f41-518f-a374-3e34424eff98 with identifier: BF77211
2026-03-30 07:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7b60a37-5f41-518f-a374-3e34424eff98 with identifier: BF77211 to the API
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BF77211>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:54:17Z',
 'fuel_type': 'diesel',
 'id': 'a7b60a37-5f41-518f-a374-3e34424eff98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF77211',
 'listing': 'auction',
 'location': 'DE, Eggenfelden',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 258986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_eb5d5dac7a4103345977054594146a86.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_8e7ad78faf8aa1db839baf489e783cc9.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_4bd565eb0d6350890f5862e68277a6af.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_d5ab849f90d5ed02254ea34bd5f6afa1.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_74d65091926f24f96653ec7e8f9bf59f.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_5e617067974e41e4d63d8719d1abdfdc.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1f132fde73d495275d37fd23d93a2709.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_3a4b42c9c7f06e5a81f0f53ffc28fd8b.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_943637ccc2bd31c0c8ffa9ec5b14628e.jpg',
                'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1b9cf82d8734f98706dd1550ed8e277e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_eb5d5dac7a4103345977054594146a86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_8e7ad78faf8aa1db839baf489e783cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_4bd565eb0d6350890f5862e68277a6af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_d5ab849f90d5ed02254ea34bd5f6afa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_74d65091926f24f96653ec7e8f9bf59f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_5e617067974e41e4d63d8719d1abdfdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1f132fde73d495275d37fd23d93a2709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_3a4b42c9c7f06e5a81f0f53ffc28fd8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_943637ccc2bd31c0c8ffa9ec5b14628e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b60a37-5f41-518f-a374-3e34424eff98/a7b60a37-5f41-518f-a374-3e34424eff98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/bb/f8bb447e3a1cb76420f9fbb5cd3c8a84/pa/BF77211_1b9cf82d8734f98706dd1550ed8e277e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2017}
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF77211%27 HTTP/1.1" 200 None
2026-03-30 07:31:53 [auto1.de] INFO: Saving data for BF77211: {'created_time': 1774855913.987219, 'last_price_update_time': 1774855913.987234, 'auction_closing_time': 1774972457.0}
2026-03-30 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF77211') HTTP/1.1" 204 0
2026-03-30 07:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_7473faf20113475500ba49d85bb06c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_7473faf20113475500ba49d85bb06c7f.jpg not downloaded yet
2026-03-30 07:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_a13d3c9d92ebfbca9792704678a7c187.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc777e90>
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_adff3d3513f33d288cbdd358c9caed2e.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_adff3d3513f33d288cbdd358c9caed2e.jpg saved to cache
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc724210>
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_d02f6f9417ee544cc1132510171256a2.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_d02f6f9417ee544cc1132510171256a2.jpg saved to cache
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc662090>
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fcd%252F3dcd9d325a4eabf854d31ad11a4ed04b%252Fpa%252FGJ50570_6c49eef4a776be1a1a657504243b13f3.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_6c49eef4a776be1a1a657504243b13f3.jpg saved to cache
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7643e662-76f0-5777-a420-4e2f5b2956ef
2026-03-30 07:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7643e662-76f0-5777-a420-4e2f5b2956ef, skipping ID generation
2026-03-30 07:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7643e662-76f0-5777-a420-4e2f5b2956ef with scrape type 1
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7643e662-76f0-5777-a420-4e2f5b2956ef sending to next pipeline
2026-03-30 07:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7643e662-76f0-5777-a420-4e2f5b2956ef, identifier: GJ50570
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_09300b744f65d5bdac887699a296ed36.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_09300b744f65d5bdac887699a296ed36.jpg not downloaded yet
2026-03-30 07:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7643e662-76f0-5777-a420-4e2f5b2956ef with identifier: GJ50570
2026-03-30 07:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7643e662-76f0-5777-a420-4e2f5b2956ef with identifier: GJ50570
2026-03-30 07:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7643e662-76f0-5777-a420-4e2f5b2956ef with identifier: GJ50570 to the API
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_6c49eef4a776be1a1a657504243b13f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:26:54Z',
 'fuel_type': 'petrol',
 'id': '7643e662-76f0-5777-a420-4e2f5b2956ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ50570',
 'listing': 'auction',
 'location': 'DE, Neumarkt in der Oberpfalz',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 130430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_4868aaedb32fca7edaadcfb297650d02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_6c49eef4a776be1a1a657504243b13f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_8115e33a6896aa18cb05363b33184ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e2facc3859ad3dd977a70f8f9ab34c33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_042a0b739ab4ef02deea38d818f7d735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_c912482c8b431f02f54148ea0d013fa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_221a7aef501d6b6151e40c1abb25b4e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_5148b4d077636be1a09369ce36f36582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_e1c4eabd16908f00a3e860c62ca6efaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7643e662-76f0-5777-a420-4e2f5b2956ef/7643e662-76f0-5777-a420-4e2f5b2956ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/cd/3dcd9d325a4eabf854d31ad11a4ed04b/pa/GJ50570_122217e510b04b9e74b5a1d2bce36318.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ50570%27 HTTP/1.1" 200 None
2026-03-30 07:31:54 [auto1.de] INFO: Saving data for GJ50570: {'created_time': 1774855914.760486, 'last_price_update_time': 1774855914.760498, 'auction_closing_time': 1774970814.0}
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ50570') HTTP/1.1" 204 0
2026-03-30 07:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_c219f6acf3e88af56fe5defb15e6a432.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg not downloaded yet
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc887b10>
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F12%252F9412ef93e1917a20298c1e042b5805dc%252Fpa%252FBK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg saved to cache
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0
2026-03-30 07:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0, skipping ID generation
2026-03-30 07:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with scrape type 1
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 sending to next pipeline
2026-03-30 07:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0, identifier: BK26573
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7bec90>
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_a13d3c9d92ebfbca9792704678a7c187.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_a13d3c9d92ebfbca9792704678a7c187.jpg saved to cache
2026-03-30 07:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_3c383e522df98122ae02ffba911c7ee3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with identifier: BK26573
2026-03-30 07:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with identifier: BK26573
2026-03-30 07:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37a32bf5-2f3f-51c2-97db-5e6d5de255d0 with identifier: BK26573 to the API
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:56:51Z',
 'fuel_type': 'petrol',
 'id': '37a32bf5-2f3f-51c2-97db-5e6d5de255d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK26573',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 102145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1996789,
             'Height': 1143,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_c6963702282be7f13eacff4479092bf9.jpg',
             'Width': 1524},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_68f99470c1823a587d7af8007bcfd3ed.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_37d4fe016efd6c3e98e9614b4f6389d2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b46c25e775125db6dc4b53e889d351e7.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_adff3d3513f33d288cbdd358c9caed2e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_72c9dccff654217cf43f4d74ce49aca1.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_2f1bdfc9a557c1f78dd97fa35e92d799.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_926a4ef1bb9fb0489928a6478b1c88dc.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_b393571a6cde3cc6b7feafb08ad11041.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a32bf5-2f3f-51c2-97db-5e6d5de255d0/37a32bf5-2f3f-51c2-97db-5e6d5de255d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/12/9412ef93e1917a20298c1e042b5805dc/pa/BK26573_23997bc643a171b26602eaf986d3cdef.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2021}
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK26573%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [auto1.de] INFO: Saving data for BK26573: {'created_time': 1774855915.442887, 'last_price_update_time': 1774855915.442898, 'auction_closing_time': 1774972611.0}
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK26573') HTTP/1.1" 204 0
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_43f117162f447fbbd6fd0d57679050f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_43f117162f447fbbd6fd0d57679050f4.jpg not downloaded yet
2026-03-30 07:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL25278> (referer: https://www.auto1.com/v1/car-details-view/AL25278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF37997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc885290>
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_c219f6acf3e88af56fe5defb15e6a432.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_c219f6acf3e88af56fe5defb15e6a432.jpg saved to cache
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc48cc50>
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_3c383e522df98122ae02ffba911c7ee3.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_3c383e522df98122ae02ffba911c7ee3.jpg saved to cache
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_905d7da74599f6c40eddbccb6453c0ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_4e873d7848886a4cc382c973a780eb4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f315340-781b-59dc-82d0-5d5beacb547a with identifier: AL25278
2026-03-30 07:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f315340-781b-59dc-82d0-5d5beacb547a with scrape type 1
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f315340-781b-59dc-82d0-5d5beacb547a
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_dcddfd8167de660afcfe80ae494b7625.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_dcddfd8167de660afcfe80ae494b7625.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_d8ed36c23a368a639f8bc38985c01619.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_d8ed36c23a368a639f8bc38985c01619.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_b5247cd74c145c16f5ef71d1f4c95fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_b5247cd74c145c16f5ef71d1f4c95fb7.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_52bf58c19913ff854fa5ac3a4ce9216c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_52bf58c19913ff854fa5ac3a4ce9216c.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_93434bdc8e9d079f8dfc5c81481b6646.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_93434bdc8e9d079f8dfc5c81481b6646.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_2acc3c9b3e5c6a68b2d02de8d7e79b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_2acc3c9b3e5c6a68b2d02de8d7e79b4e.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_884a6f08c594d70e12e31ec645e3e138.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_884a6f08c594d70e12e31ec645e3e138.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_4382af7a87900ca3d8e7ec901c56696f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_4382af7a87900ca3d8e7ec901c56696f.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_9f7099274d29d1da19b03fee479b86cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_9f7099274d29d1da19b03fee479b86cb.jpg already downloaded
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F38%252Fee38b2dc7531debc376e302328321915%252Fpa%252FAL25278_e1d397a2c334747fcd109aa0bc964a77.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_e1d397a2c334747fcd109aa0bc964a77.jpg already downloaded
2026-03-30 07:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f315340-781b-59dc-82d0-5d5beacb547a, identifier: AL25278
2026-03-30 07:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f315340-781b-59dc-82d0-5d5beacb547a with identifier: AL25278
2026-03-30 07:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f315340-781b-59dc-82d0-5d5beacb547a with identifier: AL25278
2026-03-30 07:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f315340-781b-59dc-82d0-5d5beacb547a with identifier: AL25278 to the API
2026-03-30 07:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL25278>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:20:32Z',
 'fuel_type': 'petrol',
 'id': '0f315340-781b-59dc-82d0-5d5beacb547a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL25278',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 45917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_dcddfd8167de660afcfe80ae494b7625.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_d8ed36c23a368a639f8bc38985c01619.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_b5247cd74c145c16f5ef71d1f4c95fb7.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_52bf58c19913ff854fa5ac3a4ce9216c.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_93434bdc8e9d079f8dfc5c81481b6646.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_2acc3c9b3e5c6a68b2d02de8d7e79b4e.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_884a6f08c594d70e12e31ec645e3e138.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_4382af7a87900ca3d8e7ec901c56696f.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_9f7099274d29d1da19b03fee479b86cb.jpg',
                'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_e1d397a2c334747fcd109aa0bc964a77.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_dcddfd8167de660afcfe80ae494b7625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_d8ed36c23a368a639f8bc38985c01619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_b5247cd74c145c16f5ef71d1f4c95fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_52bf58c19913ff854fa5ac3a4ce9216c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_93434bdc8e9d079f8dfc5c81481b6646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_2acc3c9b3e5c6a68b2d02de8d7e79b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_884a6f08c594d70e12e31ec645e3e138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_4382af7a87900ca3d8e7ec901c56696f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_9f7099274d29d1da19b03fee479b86cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f315340-781b-59dc-82d0-5d5beacb547a/0f315340-781b-59dc-82d0-5d5beacb547a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/38/ee38b2dc7531debc376e302328321915/pa/AL25278_e1d397a2c334747fcd109aa0bc964a77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Kasten Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten Trendline BlueMotion',
 'year': 2019}
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL25278%27 HTTP/1.1" 200 None
2026-03-30 07:31:56 [auto1.de] INFO: Saving data for AL25278: {'created_time': 1774855916.227451, 'last_price_update_time': 1774855916.227463, 'auction_closing_time': 1774970432.0}
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL25278') HTTP/1.1" 204 0
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc742190>
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ff6%252Fddf60fce90bbaaedebadc77a25e36f8b%252Fpa%252FVN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg saved to cache
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51b23751-bdd1-5a47-beea-0756fc911514
2026-03-30 07:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51b23751-bdd1-5a47-beea-0756fc911514, skipping ID generation
2026-03-30 07:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b23751-bdd1-5a47-beea-0756fc911514 with scrape type 1
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51b23751-bdd1-5a47-beea-0756fc911514 sending to next pipeline
2026-03-30 07:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51b23751-bdd1-5a47-beea-0756fc911514, identifier: VN83925
2026-03-30 07:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_09300b744f65d5bdac887699a296ed36.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG33425> (referer: https://www.auto1.com/v1/car-details-view/DG33425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51b23751-bdd1-5a47-beea-0756fc911514 with identifier: VN83925
2026-03-30 07:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51b23751-bdd1-5a47-beea-0756fc911514 with identifier: VN83925
2026-03-30 07:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51b23751-bdd1-5a47-beea-0756fc911514 with identifier: VN83925 to the API
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:57:44Z',
 'fuel_type': 'petrol',
 'id': '51b23751-bdd1-5a47-beea-0756fc911514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN83925',
 'listing': 'auction',
 'location': 'DE, Höxter',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 100415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_e69b790ec98502f8d656e9fbf8539b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_eb58d58ba44b132c0c6f90c8f68c755c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_c0bc303efc0f703deac0e06cfeab193d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81af1e87d9ad7d21a8e19eda19276749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b23751-bdd1-5a47-beea-0756fc911514/51b23751-bdd1-5a47-beea-0756fc911514_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/f6/ddf60fce90bbaaedebadc77a25e36f8b/pa/VN83925_81f425e1003f3353eedda58878780d44.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2003}
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN83925%27 HTTP/1.1" 200 None
2026-03-30 07:31:56 [auto1.de] INFO: Saving data for VN83925: {'created_time': 1774855916.802692, 'last_price_update_time': 1774855916.802703, 'auction_closing_time': 1774972664.0}
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN83925') HTTP/1.1" 204 0
2026-03-30 07:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6f98d0>
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F30%252Fcb30ee3bc28571d74758922af4d3ab13%252Fpa%252FBR21145_905d7da74599f6c40eddbccb6453c0ae.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_905d7da74599f6c40eddbccb6453c0ae.jpg saved to cache
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10b1faeb-6824-5c49-85da-4c7469f6f528
2026-03-30 07:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b1faeb-6824-5c49-85da-4c7469f6f528, skipping ID generation
2026-03-30 07:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b1faeb-6824-5c49-85da-4c7469f6f528 with scrape type 1
2026-03-30 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10b1faeb-6824-5c49-85da-4c7469f6f528 sending to next pipeline
2026-03-30 07:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b1faeb-6824-5c49-85da-4c7469f6f528, identifier: BR21145
2026-03-30 07:31:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc56c910>
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_4e873d7848886a4cc382c973a780eb4f.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_4e873d7848886a4cc382c973a780eb4f.jpg saved to cache
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB45885> (referer: https://www.auto1.com/v1/car-details-view/DB45885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b1faeb-6824-5c49-85da-4c7469f6f528 with identifier: BR21145
2026-03-30 07:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b1faeb-6824-5c49-85da-4c7469f6f528 with identifier: BR21145
2026-03-30 07:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b1faeb-6824-5c49-85da-4c7469f6f528 with identifier: BR21145 to the API
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_905d7da74599f6c40eddbccb6453c0ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:50Z',
 'fuel_type': 'diesel',
 'id': '10b1faeb-6824-5c49-85da-4c7469f6f528',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR21145',
 'listing': 'auction',
 'location': 'DE, Laatzen',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 131612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_40aee32a299e8507eed47c1a639e60b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_905d7da74599f6c40eddbccb6453c0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_afcbc7f3c3b825c846417fed7e448c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_13d545a8248ef8581b96da307df7d9ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_699b193a9ebe263b6721d162a48ef530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_b627cd2f3326fe3d5f3d45c5a681598b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_736fc9b1c05d8a9a6ce447880a80ec29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_79c7c1629b3e021d36a3936f5b092286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_c219f6acf3e88af56fe5defb15e6a432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b1faeb-6824-5c49-85da-4c7469f6f528/10b1faeb-6824-5c49-85da-4c7469f6f528_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/30/cb30ee3bc28571d74758922af4d3ab13/pa/BR21145_81d8b2cabb993cc81f72ba7aa07ff64d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR21145%27 HTTP/1.1" 200 None
2026-03-30 07:31:57 [auto1.de] INFO: Saving data for BR21145: {'created_time': 1774855917.675358, 'last_price_update_time': 1774855917.675371, 'auction_closing_time': 1774969910.0}
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR21145') HTTP/1.1" 204 0
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3dc090>
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg saved to cache
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6d0650>
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_09300b744f65d5bdac887699a296ed36.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_09300b744f65d5bdac887699a296ed36.jpg saved to cache
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30789da8-f1b0-59b4-bce2-09ab68401337 with identifier: DG33425
2026-03-30 07:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30789da8-f1b0-59b4-bce2-09ab68401337 with scrape type 1
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30789da8-f1b0-59b4-bce2-09ab68401337
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_bdd53ed807fed642015d09dd197052c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_bdd53ed807fed642015d09dd197052c6.jpg not downloaded yet
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc660cd0>
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg saved to cache
2026-03-30 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_31e3777e8784fc61cb40e7479fd18344.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_7473faf20113475500ba49d85bb06c7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_43f117162f447fbbd6fd0d57679050f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_f9ffb9f47fac2e181a32005e7df59db3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_f9ffb9f47fac2e181a32005e7df59db3.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg not downloaded yet
2026-03-30 07:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca884ce-52f4-57c7-b85f-66da1cf3c237 with identifier: DB45885
2026-03-30 07:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca884ce-52f4-57c7-b85f-66da1cf3c237 with scrape type 1
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2ca884ce-52f4-57c7-b85f-66da1cf3c237
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F12%252Fd312ce7ac1e3fc930e76a798ac73cc2d%252Fpa%252FDB45885_2fc7603fb3732912eb28b60df6474ee9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_2fc7603fb3732912eb28b60df6474ee9.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F12%252Fd312ce7ac1e3fc930e76a798ac73cc2d%252Fpa%252FDB45885_b7ad33849aab2d25466437beee5ede78.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_b7ad33849aab2d25466437beee5ede78.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F12%252Fd312ce7ac1e3fc930e76a798ac73cc2d%252Fpa%252FDB45885_445fcf45140b631354ec545ac3a5428a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_445fcf45140b631354ec545ac3a5428a.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F12%252Fd312ce7ac1e3fc930e76a798ac73cc2d%252Fpa%252FDB45885_9b6aeb83c40294430dfcfd2f36a2065c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_9b6aeb83c40294430dfcfd2f36a2065c.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F12%252Fd312ce7ac1e3fc930e76a798ac73cc2d%252Fpa%252FDB45885_f1506f109cca23e018a0f661966631b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_f1506f109cca23e018a0f661966631b0.jpg already downloaded
2026-03-30 07:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ca884ce-52f4-57c7-b85f-66da1cf3c237, identifier: DB45885
2026-03-30 07:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ca884ce-52f4-57c7-b85f-66da1cf3c237 with identifier: DB45885
2026-03-30 07:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ca884ce-52f4-57c7-b85f-66da1cf3c237 with identifier: DB45885
2026-03-30 07:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ca884ce-52f4-57c7-b85f-66da1cf3c237 with identifier: DB45885 to the API
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB45885>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:15:20Z',
 'fuel_type': 'petrol',
 'id': '2ca884ce-52f4-57c7-b85f-66da1cf3c237',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB45885',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 108759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_2fc7603fb3732912eb28b60df6474ee9.jpg',
                'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_b7ad33849aab2d25466437beee5ede78.jpg',
                'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_445fcf45140b631354ec545ac3a5428a.jpg',
                'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_9b6aeb83c40294430dfcfd2f36a2065c.jpg',
                'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_f1506f109cca23e018a0f661966631b0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca884ce-52f4-57c7-b85f-66da1cf3c237/2ca884ce-52f4-57c7-b85f-66da1cf3c237_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_2fc7603fb3732912eb28b60df6474ee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca884ce-52f4-57c7-b85f-66da1cf3c237/2ca884ce-52f4-57c7-b85f-66da1cf3c237_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_b7ad33849aab2d25466437beee5ede78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca884ce-52f4-57c7-b85f-66da1cf3c237/2ca884ce-52f4-57c7-b85f-66da1cf3c237_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_445fcf45140b631354ec545ac3a5428a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca884ce-52f4-57c7-b85f-66da1cf3c237/2ca884ce-52f4-57c7-b85f-66da1cf3c237_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_9b6aeb83c40294430dfcfd2f36a2065c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca884ce-52f4-57c7-b85f-66da1cf3c237/2ca884ce-52f4-57c7-b85f-66da1cf3c237_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/12/d312ce7ac1e3fc930e76a798ac73cc2d/pa/DB45885_f1506f109cca23e018a0f661966631b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45885%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [auto1.de] INFO: Saving data for DB45885: {'created_time': 1774855918.563756, 'last_price_update_time': 1774855918.563767, 'auction_closing_time': 1774970120.0}
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB45885') HTTP/1.1" 204 0
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_d229ed348d5afc2fb42c79110ae5cb35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d229ed348d5afc2fb42c79110ae5cb35.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_3f605fd3ae1b3b34e231dbd319e3c30c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_3f605fd3ae1b3b34e231dbd319e3c30c.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_f60df53944a8eeefcc3e94896f5a66d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_f60df53944a8eeefcc3e94896f5a66d7.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_d378715a8bf8aefbc929be92840ae1ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d378715a8bf8aefbc929be92840ae1ac.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_b242fc206279206135a9a5b1e9bdc4f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_b242fc206279206135a9a5b1e9bdc4f8.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_2b7a4277112dffe5861099bebda03c03.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_2b7a4277112dffe5861099bebda03c03.jpg already downloaded
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_0f4d8831beeecef9daffb6396dd10e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_0f4d8831beeecef9daffb6396dd10e36.jpg already downloaded
2026-03-30 07:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_ad4f9883759e406f4425a052e18dd3eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_01d806818c84698e71dd60e27cfeafbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc588750>
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_31e3777e8784fc61cb40e7479fd18344.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_31e3777e8784fc61cb40e7479fd18344.jpg saved to cache
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc622490>
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_7473faf20113475500ba49d85bb06c7f.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_7473faf20113475500ba49d85bb06c7f.jpg saved to cache
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc54ce10>
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Ffc%252F54fc1eabe9ee99d894c996453cf429be%252Fpa%252FTZ85703_43f117162f447fbbd6fd0d57679050f4.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_43f117162f447fbbd6fd0d57679050f4.jpg saved to cache
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5484353f-ec5a-51c7-8166-5d919e65f8d5
2026-03-30 07:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5484353f-ec5a-51c7-8166-5d919e65f8d5, skipping ID generation
2026-03-30 07:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5484353f-ec5a-51c7-8166-5d919e65f8d5 with scrape type 1
2026-03-30 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5484353f-ec5a-51c7-8166-5d919e65f8d5 sending to next pipeline
2026-03-30 07:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5484353f-ec5a-51c7-8166-5d919e65f8d5, identifier: TZ85703
2026-03-30 07:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5484353f-ec5a-51c7-8166-5d919e65f8d5 with identifier: TZ85703
2026-03-30 07:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5484353f-ec5a-51c7-8166-5d919e65f8d5 with identifier: TZ85703
2026-03-30 07:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5484353f-ec5a-51c7-8166-5d919e65f8d5 with identifier: TZ85703 to the API
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_43f117162f447fbbd6fd0d57679050f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:43:27Z',
 'fuel_type': 'diesel',
 'id': '5484353f-ec5a-51c7-8166-5d919e65f8d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ85703',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 307626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_40dca8c24260f66e9e2fa00e0905db28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_7473faf20113475500ba49d85bb06c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_09300b744f65d5bdac887699a296ed36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_1b1d38b1f66a15ba831c12e4b4ac15dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5484353f-ec5a-51c7-8166-5d919e65f8d5/5484353f-ec5a-51c7-8166-5d919e65f8d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/fc/54fc1eabe9ee99d894c996453cf429be/pa/TZ85703_43f117162f447fbbd6fd0d57679050f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2007}
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ85703%27 HTTP/1.1" 200 None
2026-03-30 07:31:59 [auto1.de] INFO: Saving data for TZ85703: {'created_time': 1774855919.338121, 'last_price_update_time': 1774855919.338137, 'auction_closing_time': 1774971807.0}
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ85703') HTTP/1.1" 204 0
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_28515157a8589c8cf9ca701095fc031f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_efef08c04d9b339851dd328332492f18.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ06003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_1ef161329ceb6580fde7c02d61c61929.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_acdef7ff00f225466b643f4d4729021e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF37997> (referer: https://www.auto1.com/v1/car-details-view/CF37997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_7857a453f92ce0aabf2b60d304a045c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc621550>
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_ad4f9883759e406f4425a052e18dd3eb.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_ad4f9883759e406f4425a052e18dd3eb.jpg saved to cache
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6f8590>
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F98%252Fba9855bd09a2dd6e5fbb0e19a691bb4b%252Fpa%252FHR38686_01d806818c84698e71dd60e27cfeafbd.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_01d806818c84698e71dd60e27cfeafbd.jpg saved to cache
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d
2026-03-30 07:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d, skipping ID generation
2026-03-30 07:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with scrape type 1
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d sending to next pipeline
2026-03-30 07:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d, identifier: HR38686
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc91b910>
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd5%252F1ad58c6630b09f0eff796d8a7b458128%252Fpa%252FEG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg') HTTP/1.1" 204 0
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg saved to cache
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1be64305-9caf-5158-b2f1-8feda56e0553
2026-03-30 07:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1be64305-9caf-5158-b2f1-8feda56e0553, skipping ID generation
2026-03-30 07:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be64305-9caf-5158-b2f1-8feda56e0553 with scrape type 1
2026-03-30 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1be64305-9caf-5158-b2f1-8feda56e0553 sending to next pipeline
2026-03-30 07:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1be64305-9caf-5158-b2f1-8feda56e0553, identifier: EG30770
2026-03-30 07:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with identifier: HR38686
2026-03-30 07:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with identifier: HR38686
2026-03-30 07:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5141c1eb-07c7-5b4e-b966-c3d3525a4a1d with identifier: HR38686 to the API
2026-03-30 07:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_01d806818c84698e71dd60e27cfeafbd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:11:24Z',
 'fuel_type': 'petrol',
 'id': '5141c1eb-07c7-5b4e-b966-c3d3525a4a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR38686',
 'listing': 'auction',
 'location': 'DE, Euskirchen',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 126595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_29bf630b0ec9aaeec78d5b387b50f453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_01d806818c84698e71dd60e27cfeafbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_4dc99044101bd532935bc7f4ae56a3ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_31e3777e8784fc61cb40e7479fd18344.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141c1eb-07c7-5b4e-b966-c3d3525a4a1d/5141c1eb-07c7-5b4e-b966-c3d3525a4a1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/98/ba9855bd09a2dd6e5fbb0e19a691bb4b/pa/HR38686_3c383e522df98122ae02ffba911c7ee3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LS +',
 'transmission': 'manual',
 'trim': 'LS +',
 'year': 2011}
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR38686%27 HTTP/1.1" 200 None
2026-03-30 07:32:00 [auto1.de] INFO: Saving data for HR38686: {'created_time': 1774855920.216085, 'last_price_update_time': 1774855920.216098, 'auction_closing_time': 1774969884.0}
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR38686') HTTP/1.1" 204 0
2026-03-30 07:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1be64305-9caf-5158-b2f1-8feda56e0553 with identifier: EG30770
2026-03-30 07:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1be64305-9caf-5158-b2f1-8feda56e0553 with identifier: EG30770
2026-03-30 07:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1be64305-9caf-5158-b2f1-8feda56e0553 with identifier: EG30770 to the API
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': 'Taxi',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.7L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:06:02Z',
 'fuel_type': 'diesel',
 'id': '1be64305-9caf-5158-b2f1-8feda56e0553',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG30770',
 'listing': 'auction',
 'location': 'Kempten (Allgäu)',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 345996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_7a0ede8b180e3d39cf9cb604719465be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_884102e8d93f74dd019710c4e4f1c074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_ad4f9883759e406f4425a052e18dd3eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_10ce13560fbc7f16b8d3a95208bf188d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_67b86d427833e55658d0922590c426d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1be64305-9caf-5158-b2f1-8feda56e0553/1be64305-9caf-5158-b2f1-8feda56e0553_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d5/1ad58c6630b09f0eff796d8a7b458128/pa/EG30770_a49631d27e5de7b80eb76eea6863c4d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG30770%27 HTTP/1.1" 200 None
2026-03-30 07:32:00 [auto1.de] INFO: Saving data for EG30770: {'created_time': 1774855920.642197, 'last_price_update_time': 1774855920.642208, 'auction_closing_time': 1774969562.0}
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG30770') HTTP/1.1" 204 0
2026-03-30 07:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_bdd53ed807fed642015d09dd197052c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_d698ae0494a66a0db0016f97803171d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY49050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:00 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 7256 | hits on page: 40
2026-03-30 07:32:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2d3390>
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg saved to cache
2026-03-30 07:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:32:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc63fd10>
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fe3%252F2ae3606f5b7eed879f6ec0f0e77c8349%252Fpa%252FVF16052_28515157a8589c8cf9ca701095fc031f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_28515157a8589c8cf9ca701095fc031f.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8
2026-03-30 07:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8, skipping ID generation
2026-03-30 07:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with scrape type 1
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 sending to next pipeline
2026-03-30 07:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8, identifier: VF16052
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2e16d0>
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc75cd90>
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_efef08c04d9b339851dd328332492f18.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_efef08c04d9b339851dd328332492f18.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc900410>
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_1ef161329ceb6580fde7c02d61c61929.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_1ef161329ceb6580fde7c02d61c61929.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc990890>
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_acdef7ff00f225466b643f4d4729021e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_acdef7ff00f225466b643f4d4729021e.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7547f61e-0ee1-55ca-b24a-ffdb9bd93310 with identifier: CF37997
2026-03-30 07:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7547f61e-0ee1-55ca-b24a-ffdb9bd93310 with scrape type 1
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7547f61e-0ee1-55ca-b24a-ffdb9bd93310
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_e16a3551d378cb9f9490fd4e16d86eab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_e16a3551d378cb9f9490fd4e16d86eab.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_59477b702238e5ca90699eb0fd714592.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_59477b702238e5ca90699eb0fd714592.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_954220122a423246c04b9ff1a40c1ce2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_954220122a423246c04b9ff1a40c1ce2.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_815c223b3566a6cf9b2441856dab332b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_815c223b3566a6cf9b2441856dab332b.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_a5a74723a104b583b77b03ea7c4532fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_a5a74723a104b583b77b03ea7c4532fa.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_992bb25aead5425b65e9a150ceb1fad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_992bb25aead5425b65e9a150ceb1fad2.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_3afa66df6f9506ef1398a84eabe2c836.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_3afa66df6f9506ef1398a84eabe2c836.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_0f9318b6f59b8693684a0e2fb2f90874.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_0f9318b6f59b8693684a0e2fb2f90874.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_41f30729d8120ce105be0b060da53914.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_41f30729d8120ce105be0b060da53914.jpg already downloaded
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F8b%252F248bdf95f28a5b12823f9d0e760ec740%252Fpa%252FCF37997_aaaf07515afe0fa7fd20a69b56f1882a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_aaaf07515afe0fa7fd20a69b56f1882a.jpg already downloaded
2026-03-30 07:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7547f61e-0ee1-55ca-b24a-ffdb9bd93310, identifier: CF37997
2026-03-30 07:32:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2c2750>
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_7857a453f92ce0aabf2b60d304a045c4.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_7857a453f92ce0aabf2b60d304a045c4.jpg saved to cache
2026-03-30 07:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_828eca6a7c03dc47839956201f5f05bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with identifier: VF16052
2026-03-30 07:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with identifier: VF16052
2026-03-30 07:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c82a4ce-1c59-5ba1-8e68-38c02db46fd8 with identifier: VF16052 to the API
2026-03-30 07:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_28515157a8589c8cf9ca701095fc031f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:21:53Z',
 'fuel_type': 'diesel',
 'id': '5c82a4ce-1c59-5ba1-8e68-38c02db46fd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF16052',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 238357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_28515157a8589c8cf9ca701095fc031f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_4589e9adfe250abaa450c743f108e86b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_a13d3c9d92ebfbca9792704678a7c187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_5b4955ab30621c01cf0fbb804acfb4d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_d02f6f9417ee544cc1132510171256a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2a8794f9cdf1ef76fd971b48b095c663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_460ce8e62cf8cf5d3b2fab4a639216f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_bb84ad5c21951e9d650f17b81b490bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_2991b791fd6c946ce04677845ae78cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c82a4ce-1c59-5ba1-8e68-38c02db46fd8/5c82a4ce-1c59-5ba1-8e68-38c02db46fd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/e3/2ae3606f5b7eed879f6ec0f0e77c8349/pa/VF16052_f08cce9b34c39740289660b31eadbce9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF16052%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Saving data for VF16052: {'created_time': 1774855922.288943, 'last_price_update_time': 1774855922.288956, 'auction_closing_time': 1774970513.0}
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF16052') HTTP/1.1" 204 0
2026-03-30 07:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7547f61e-0ee1-55ca-b24a-ffdb9bd93310 with identifier: CF37997
2026-03-30 07:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7547f61e-0ee1-55ca-b24a-ffdb9bd93310 with identifier: CF37997
2026-03-30 07:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7547f61e-0ee1-55ca-b24a-ffdb9bd93310 with identifier: CF37997 to the API
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF37997>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:43:35Z',
 'fuel_type': 'petrol',
 'id': '7547f61e-0ee1-55ca-b24a-ffdb9bd93310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF37997',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 162734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_e16a3551d378cb9f9490fd4e16d86eab.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_59477b702238e5ca90699eb0fd714592.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_954220122a423246c04b9ff1a40c1ce2.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_815c223b3566a6cf9b2441856dab332b.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_a5a74723a104b583b77b03ea7c4532fa.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_992bb25aead5425b65e9a150ceb1fad2.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_3afa66df6f9506ef1398a84eabe2c836.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_0f9318b6f59b8693684a0e2fb2f90874.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_41f30729d8120ce105be0b060da53914.jpg',
                'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_aaaf07515afe0fa7fd20a69b56f1882a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_e16a3551d378cb9f9490fd4e16d86eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_59477b702238e5ca90699eb0fd714592.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_954220122a423246c04b9ff1a40c1ce2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_815c223b3566a6cf9b2441856dab332b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_a5a74723a104b583b77b03ea7c4532fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_992bb25aead5425b65e9a150ceb1fad2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767111,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_3afa66df6f9506ef1398a84eabe2c836.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_0f9318b6f59b8693684a0e2fb2f90874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_41f30729d8120ce105be0b060da53914.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7547f61e-0ee1-55ca-b24a-ffdb9bd93310/7547f61e-0ee1-55ca-b24a-ffdb9bd93310_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/8b/248bdf95f28a5b12823f9d0e760ec740/pa/CF37997_aaaf07515afe0fa7fd20a69b56f1882a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF37997%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Saving data for CF37997: {'created_time': 1774855922.736399, 'last_price_update_time': 1774855922.736411, 'auction_closing_time': 1774971815.0}
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF37997') HTTP/1.1" 204 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN21197%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for PN21197: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE43577%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for AE43577: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29353%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for AG29353: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ85703%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for TZ85703: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR86054%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for UR86054: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: RX59443
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX59443%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for RX59443: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: UB75058
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB75058%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for UB75058: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: TE16173
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: SC19124
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: YT41914
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: SV96004
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: CF37997
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF37997%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for CF37997: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: FA11917
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA11917%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for FA11917: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX58927%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for DX58927: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: XD63498
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: JB86449
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35762%27 HTTP/1.1" 200 None
2026-03-30 07:32:02 [auto1.de] INFO: Scrape type for WP35762: 0
2026-03-30 07:32:02 [auto1.de] INFO: Found listing with ID: UZ06003
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc49a890>
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg saved to cache
2026-03-30 07:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30789da8-f1b0-59b4-bce2-09ab68401337
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc627650>
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F36%252F92361dc0f46c15ba58db60e432756d61%252Fpa%252FDG33425_bdd53ed807fed642015d09dd197052c6.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_bdd53ed807fed642015d09dd197052c6.jpg saved to cache
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30789da8-f1b0-59b4-bce2-09ab68401337
2026-03-30 07:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30789da8-f1b0-59b4-bce2-09ab68401337, skipping ID generation
2026-03-30 07:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30789da8-f1b0-59b4-bce2-09ab68401337 with scrape type 1
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30789da8-f1b0-59b4-bce2-09ab68401337 sending to next pipeline
2026-03-30 07:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30789da8-f1b0-59b4-bce2-09ab68401337, identifier: DG33425
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc859dd0>
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_d698ae0494a66a0db0016f97803171d0.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_d698ae0494a66a0db0016f97803171d0.jpg saved to cache
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc97d390>
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg saved to cache
2026-03-30 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: FU96820
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: LZ51048
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51048%27 HTTP/1.1" 200 None
2026-03-30 07:32:03 [auto1.de] INFO: Scrape type for LZ51048: 0
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-30 07:32:03 [auto1.de] INFO: Scrape type for CS88634: 0
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: VV53605
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV53605%27 HTTP/1.1" 200 None
2026-03-30 07:32:03 [auto1.de] INFO: Scrape type for VV53605: 0
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: YS60575
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS60575%27 HTTP/1.1" 200 None
2026-03-30 07:32:03 [auto1.de] INFO: Scrape type for YS60575: 0
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 07:32:03 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 07:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30789da8-f1b0-59b4-bce2-09ab68401337 with identifier: DG33425
2026-03-30 07:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30789da8-f1b0-59b4-bce2-09ab68401337 with identifier: DG33425
2026-03-30 07:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30789da8-f1b0-59b4-bce2-09ab68401337 with identifier: DG33425 to the API
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_bdd53ed807fed642015d09dd197052c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:01:28Z',
 'fuel_type': 'petrol',
 'id': '30789da8-f1b0-59b4-bce2-09ab68401337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG33425',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 77441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_bdd53ed807fed642015d09dd197052c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_f9ffb9f47fac2e181a32005e7df59db3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d8bef3f786be48947f43ee2c2132d5fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d229ed348d5afc2fb42c79110ae5cb35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_3f605fd3ae1b3b34e231dbd319e3c30c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_f60df53944a8eeefcc3e94896f5a66d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_d378715a8bf8aefbc929be92840ae1ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_b242fc206279206135a9a5b1e9bdc4f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_2b7a4277112dffe5861099bebda03c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30789da8-f1b0-59b4-bce2-09ab68401337/30789da8-f1b0-59b4-bce2-09ab68401337_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/36/92361dc0f46c15ba58db60e432756d61/pa/DG33425_0f4d8831beeecef9daffb6396dd10e36.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG33425%27 HTTP/1.1" 200 None
2026-03-30 07:32:03 [auto1.de] INFO: Saving data for DG33425: {'created_time': 1774855923.76356, 'last_price_update_time': 1774855923.763572, 'auction_closing_time': 1774969288.0}
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG33425') HTTP/1.1" 204 0
2026-03-30 07:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc624890>
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fa5%252Fc5a5223fcfd2a53456fb0e0084a27a94%252Fpa%252FDB70642_828eca6a7c03dc47839956201f5f05bc.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_828eca6a7c03dc47839956201f5f05bc.jpg saved to cache
2026-03-30 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f
2026-03-30 07:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c2ef6ef-e0e1-5d0c-823b-85566266755f, skipping ID generation
2026-03-30 07:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f with scrape type 1
2026-03-30 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c2ef6ef-e0e1-5d0c-823b-85566266755f sending to next pipeline
2026-03-30 07:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c2ef6ef-e0e1-5d0c-823b-85566266755f, identifier: DB70642
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD75642%27 HTTP/1.1" 200 None
2026-03-30 07:32:04 [auto1.de] INFO: Scrape type for GD75642: 0
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45885%27 HTTP/1.1" 200 None
2026-03-30 07:32:04 [auto1.de] INFO: Scrape type for DB45885: 0
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79553%27 HTTP/1.1" 200 None
2026-03-30 07:32:04 [auto1.de] INFO: Scrape type for JE79553: 0
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM55241%27 HTTP/1.1" 200 None
2026-03-30 07:32:04 [auto1.de] INFO: Scrape type for LM55241: 0
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 07:32:04 [auto1.de] INFO: Found listing with ID: TN02521
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN02521%27 HTTP/1.1" 200 None
2026-03-30 07:32:04 [auto1.de] INFO: Scrape type for TN02521: 2
2026-03-30 07:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a05756cf-97bf-51cd-9ca2-584b0dacb350 with identifier: TN02521
2026-03-30 07:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a05756cf-97bf-51cd-9ca2-584b0dacb350 with scrape type 2
2026-03-30 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a05756cf-97bf-51cd-9ca2-584b0dacb350 with scrape type 2
2026-03-30 07:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a05756cf-97bf-51cd-9ca2-584b0dacb350, identifier: TN02521
2026-03-30 07:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c2ef6ef-e0e1-5d0c-823b-85566266755f with identifier: DB70642
2026-03-30 07:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c2ef6ef-e0e1-5d0c-823b-85566266755f with identifier: DB70642
2026-03-30 07:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c2ef6ef-e0e1-5d0c-823b-85566266755f with identifier: DB70642 to the API
2026-03-30 07:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_828eca6a7c03dc47839956201f5f05bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:19Z',
 'fuel_type': 'petrol',
 'id': '8c2ef6ef-e0e1-5d0c-823b-85566266755f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB70642',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 148707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_9e50ee4ac481aa19c75f50de84e8b55f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3113814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_828eca6a7c03dc47839956201f5f05bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3295323,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bb9580648b31d0e980c7f71b5e2733bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3122687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_7857a453f92ce0aabf2b60d304a045c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_bd75b5e79e5ddb330b0949cea5f08b56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_b5414d4950d2d22551da4c5578cff95b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3014861,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_1ef161329ceb6580fde7c02d61c61929.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_dc5564fd90ba7e437ae705618be5b8ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_4e873d7848886a4cc382c973a780eb4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2ef6ef-e0e1-5d0c-823b-85566266755f/8c2ef6ef-e0e1-5d0c-823b-85566266755f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/a5/c5a5223fcfd2a53456fb0e0084a27a94/pa/DB70642_f8dc23bcb3c6d8e3c80860b8de46bec2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB70642%27 HTTP/1.1" 200 None
2026-03-30 07:32:05 [auto1.de] INFO: Saving data for DB70642: {'created_time': 1774855925.510267, 'last_price_update_time': 1774855925.510278, 'auction_closing_time': 1774971859.0}
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB70642') HTTP/1.1" 204 0
2026-03-30 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a05756cf-97bf-51cd-9ca2-584b0dacb350 with identifier: TN02521
2026-03-30 07:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a05756cf-97bf-51cd-9ca2-584b0dacb350 with identifier: TN02521
2026-03-30 07:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a05756cf-97bf-51cd-9ca2-584b0dacb350 with identifier: TN02521 to the API
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:47:39Z',
 'fuel_type': 'petrol',
 'id': 'a05756cf-97bf-51cd-9ca2-584b0dacb350',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN02521',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 162725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2017}
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN02521%27 HTTP/1.1" 200 None
2026-03-30 07:32:05 [auto1.de] INFO: Saving data for TN02521: {'auction_closing_time': 1774972059.0, 'created_time': 1773773093.629398, 'last_price_update_time': 1774855925.981641}
2026-03-30 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN02521') HTTP/1.1" 204 0
2026-03-30 07:32:06 [auto1.de] INFO: Found listing with ID: DJ06926
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ06926%27 HTTP/1.1" 200 None
2026-03-30 07:32:06 [auto1.de] INFO: Scrape type for DJ06926: 1
2026-03-30 07:32:06 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP46959%27 HTTP/1.1" 200 None
2026-03-30 07:32:06 [auto1.de] INFO: Scrape type for HP46959: 2
2026-03-30 07:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with identifier: HP46959
2026-03-30 07:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with scrape type 2
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with scrape type 2
2026-03-30 07:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdc1f031-d7fc-58d2-bbc0-b8cd06a42651, identifier: HP46959
2026-03-30 07:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with identifier: HP46959
2026-03-30 07:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with identifier: HP46959
2026-03-30 07:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdc1f031-d7fc-58d2-bbc0-b8cd06a42651 with identifier: HP46959 to the API
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:26:34Z',
 'fuel_type': 'diesel',
 'id': 'cdc1f031-d7fc-58d2-bbc0-b8cd06a42651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP46959',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 204350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-01',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach 4Motion',
 'transmission': 'automatic',
 'trim': 'Beach 4Motion',
 'year': 2016}
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP46959%27 HTTP/1.1" 200 None
2026-03-30 07:32:06 [auto1.de] INFO: Saving data for HP46959: {'auction_closing_time': 1774970794.0, 'created_time': 1774348542.302473, 'last_price_update_time': 1774855926.572905}
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP46959') HTTP/1.1" 204 0
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_8b81e122bbc01852666b70f8caf441c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 55 pages/min), scraped 107 items (at 64 items/min)
2026-03-30 07:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_7b6790fb946098ba613245d5fb2076e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_320a02f0381c2f5c7520db94b76a462f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_c9f85a6798dd30dcc28a740f27edef98.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_1eb62f243aef5e481b454fdddff7f31f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_e397c45d7f950dacb80d78723f577ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc793010>
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg saved to cache
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3d3690>
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_8b81e122bbc01852666b70f8caf441c3.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_8b81e122bbc01852666b70f8caf441c3.jpg saved to cache
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_577cd8f544a819653b22d0e249470c4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc5183d0>
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_7b6790fb946098ba613245d5fb2076e2.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_7b6790fb946098ba613245d5fb2076e2.jpg saved to cache
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc75afd0>
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg saved to cache
2026-03-30 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc792b10>
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_320a02f0381c2f5c7520db94b76a462f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_320a02f0381c2f5c7520db94b76a462f.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6fa610>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2c2150>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be818e10>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_c9f85a6798dd30dcc28a740f27edef98.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_c9f85a6798dd30dcc28a740f27edef98.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7d2110>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_1eb62f243aef5e481b454fdddff7f31f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_1eb62f243aef5e481b454fdddff7f31f.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD78216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL52621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc674690>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fec%252Ffaeca46dbec15b059eaf12adaff1436a%252Fpa%252FXN56575_e397c45d7f950dacb80d78723f577ea9.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_e397c45d7f950dacb80d78723f577ea9.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde
2026-03-30 07:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde, skipping ID generation
2026-03-30 07:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with scrape type 1
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1852d234-6fc1-541b-bbb9-0fd8f6c93dde sending to next pipeline
2026-03-30 07:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde, identifier: XN56575
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7d1010>
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_577cd8f544a819653b22d0e249470c4a.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_577cd8f544a819653b22d0e249470c4a.jpg saved to cache
2026-03-30 07:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with identifier: XN56575
2026-03-30 07:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with identifier: XN56575
2026-03-30 07:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1852d234-6fc1-541b-bbb9-0fd8f6c93dde with identifier: XN56575 to the API
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_e397c45d7f950dacb80d78723f577ea9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:39:02Z',
 'fuel_type': 'diesel',
 'id': '1852d234-6fc1-541b-bbb9-0fd8f6c93dde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN56575',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 13207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54803,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_f38d1cdb6844d494cb9d344463e76734.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47867,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_e397c45d7f950dacb80d78723f577ea9.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53199,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_8b81e122bbc01852666b70f8caf441c3.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54507,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_eb6a77b6ce544a0f3ef1001a571198e8.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67039,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_d698ae0494a66a0db0016f97803171d0.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41564,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_efef08c04d9b339851dd328332492f18.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1852d234-6fc1-541b-bbb9-0fd8f6c93dde/1852d234-6fc1-541b-bbb9-0fd8f6c93dde_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51496,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ec/faeca46dbec15b059eaf12adaff1436a/pa/XN56575_afa15e5f5fc85e38c6d88e2ac974ba4b.jpg',
             'Width': 688}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN56575%27 HTTP/1.1" 200 None
2026-03-30 07:32:08 [auto1.de] INFO: Saving data for XN56575: {'created_time': 1774855928.640278, 'last_price_update_time': 1774855928.640291, 'auction_closing_time': 1774971542.0}
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN56575') HTTP/1.1" 204 0
2026-03-30 07:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ06003> (referer: https://www.auto1.com/v1/car-details-view/UZ06003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc567150>
2026-03-30 07:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8f%252F068fd8115da2b5650a6d2ddfaa7c42f9%252Fpa%252FBZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg saved to cache
2026-03-30 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d99703c-c60c-5083-a0dc-d4824a9876a5
2026-03-30 07:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d99703c-c60c-5083-a0dc-d4824a9876a5, skipping ID generation
2026-03-30 07:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d99703c-c60c-5083-a0dc-d4824a9876a5 with scrape type 1
2026-03-30 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d99703c-c60c-5083-a0dc-d4824a9876a5 sending to next pipeline
2026-03-30 07:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d99703c-c60c-5083-a0dc-d4824a9876a5, identifier: BZ48067
2026-03-30 07:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ06926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB29861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d99703c-c60c-5083-a0dc-d4824a9876a5 with identifier: BZ48067
2026-03-30 07:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d99703c-c60c-5083-a0dc-d4824a9876a5 with identifier: BZ48067
2026-03-30 07:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d99703c-c60c-5083-a0dc-d4824a9876a5 with identifier: BZ48067 to the API
2026-03-30 07:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:25:00Z',
 'fuel_type': 'petrol',
 'id': '1d99703c-c60c-5083-a0dc-d4824a9876a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ48067',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 117514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_e31a1922b61b0126bc0ecc44658ee3c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0ff29e2c8c61feef7d77a764cc30eedc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_7352b8310dd953a81d6f1ba8375b6507.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_9f9627f405b3be4ddc8f63dd8ce9975c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_8bc0b35b27fd581580f0f9a5197e8847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_acdef7ff00f225466b643f4d4729021e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_06e1bf18c42ecc75765e2102f21a5cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_0640ef664684142afcf1bc599a7d3e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4b5fa8a46511995bdfe4f77e905daeeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d99703c-c60c-5083-a0dc-d4824a9876a5/1d99703c-c60c-5083-a0dc-d4824a9876a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/8f/068fd8115da2b5650a6d2ddfaa7c42f9/pa/BZ48067_4544993712ff27b8512ec8fe27e304d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ48067%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [auto1.de] INFO: Saving data for BZ48067: {'created_time': 1774855929.507952, 'last_price_update_time': 1774855929.507965, 'auction_closing_time': 1774970700.0}
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ48067') HTTP/1.1" 204 0
2026-03-30 07:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_bae71e1958ea9b73117a77bef0ff4925.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_b1264981b4ca3c03f601f890bb7740dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee20b41-e10e-5c44-ac97-bbc5d395edfd with identifier: UZ06003
2026-03-30 07:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee20b41-e10e-5c44-ac97-bbc5d395edfd with scrape type 1
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ee20b41-e10e-5c44-ac97-bbc5d395edfd
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_8df303a91c2191337e0391f5eb6b47f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8df303a91c2191337e0391f5eb6b47f7.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_2fef6fb93269eacf6c25c3b8d1f05266.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2fef6fb93269eacf6c25c3b8d1f05266.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_ceec91984071b1f65bc129271c5f513e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_ceec91984071b1f65bc129271c5f513e.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_4e3a1a0460c4b59ceef4f6eba189ec62.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_4e3a1a0460c4b59ceef4f6eba189ec62.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_2bfb21506de7ad9230aff1d5b89c58f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bfb21506de7ad9230aff1d5b89c58f1.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_2bed2255508f7453ab91980909c5c1ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bed2255508f7453ab91980909c5c1ab.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_26a01f7eff722b5683f36582e04c7b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_26a01f7eff722b5683f36582e04c7b61.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_8a29bcce621afe7b67055defe52530d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8a29bcce621afe7b67055defe52530d8.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_8083a002e199973df7628e2bfa4e922c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8083a002e199973df7628e2bfa4e922c.jpg already downloaded
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fff%252Fc4ff6dc2ac5281e0bb17a352ffa1ce9f%252Fpa%252FUZ06003_a389a0337e9f9bd9c9a61979b2d6b68d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_a389a0337e9f9bd9c9a61979b2d6b68d.jpg already downloaded
2026-03-30 07:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ee20b41-e10e-5c44-ac97-bbc5d395edfd, identifier: UZ06003
2026-03-30 07:32:09 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 7270 | hits on page: 40
2026-03-30 07:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ee20b41-e10e-5c44-ac97-bbc5d395edfd with identifier: UZ06003
2026-03-30 07:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:32:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 07:32:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ee20b41-e10e-5c44-ac97-bbc5d395edfd with identifier: UZ06003
2026-03-30 07:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ee20b41-e10e-5c44-ac97-bbc5d395edfd with identifier: UZ06003 to the API
2026-03-30 07:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ06003>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:29:30Z',
 'fuel_type': 'petrol',
 'id': '5ee20b41-e10e-5c44-ac97-bbc5d395edfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ06003',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 239271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8df303a91c2191337e0391f5eb6b47f7.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2fef6fb93269eacf6c25c3b8d1f05266.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_ceec91984071b1f65bc129271c5f513e.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_4e3a1a0460c4b59ceef4f6eba189ec62.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bfb21506de7ad9230aff1d5b89c58f1.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bed2255508f7453ab91980909c5c1ab.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_26a01f7eff722b5683f36582e04c7b61.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8a29bcce621afe7b67055defe52530d8.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8083a002e199973df7628e2bfa4e922c.jpg',
                'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_a389a0337e9f9bd9c9a61979b2d6b68d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8df303a91c2191337e0391f5eb6b47f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2fef6fb93269eacf6c25c3b8d1f05266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_ceec91984071b1f65bc129271c5f513e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_4e3a1a0460c4b59ceef4f6eba189ec62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bfb21506de7ad9230aff1d5b89c58f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_2bed2255508f7453ab91980909c5c1ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_26a01f7eff722b5683f36582e04c7b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8a29bcce621afe7b67055defe52530d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_8083a002e199973df7628e2bfa4e922c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee20b41-e10e-5c44-ac97-bbc5d395edfd/5ee20b41-e10e-5c44-ac97-bbc5d395edfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/ff/c4ff6dc2ac5281e0bb17a352ffa1ce9f/pa/UZ06003_a389a0337e9f9bd9c9a61979b2d6b68d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ06003%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Saving data for UZ06003: {'created_time': 1774855931.303975, 'last_price_update_time': 1774855931.303988, 'auction_closing_time': 1774970970.0}
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ06003') HTTP/1.1" 204 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG33425%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for DG33425: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD75642%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for GD75642: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45885%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for DB45885: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79553%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for JE79553: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM55241%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for LM55241: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: TN02521
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN02521%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for TN02521: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: DJ06926
2026-03-30 07:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc777250>
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_bae71e1958ea9b73117a77bef0ff4925.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_bae71e1958ea9b73117a77bef0ff4925.jpg saved to cache
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4008d0>
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_b1264981b4ca3c03f601f890bb7740dd.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_b1264981b4ca3c03f601f890bb7740dd.jpg saved to cache
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3fa990>
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg saved to cache
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc403250>
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg saved to cache
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_3151abe59f8b201f8515a5828b57f07f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP46959%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for HP46959: 0
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: EP15828
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP15828%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for EP15828: 1
2026-03-30 07:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: CD29935
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD29935%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for CD29935: 1
2026-03-30 07:32:11 [auto1.de] INFO: Found listing with ID: BX02893
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX02893%27 HTTP/1.1" 200 None
2026-03-30 07:32:11 [auto1.de] INFO: Scrape type for BX02893: 2
2026-03-30 07:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6534b99-98b6-598f-8fb8-a237580317b5 with identifier: BX02893
2026-03-30 07:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6534b99-98b6-598f-8fb8-a237580317b5 with scrape type 2
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6534b99-98b6-598f-8fb8-a237580317b5 with scrape type 2
2026-03-30 07:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6534b99-98b6-598f-8fb8-a237580317b5, identifier: BX02893
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7bfa10>
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg saved to cache
2026-03-30 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6534b99-98b6-598f-8fb8-a237580317b5 with identifier: BX02893
2026-03-30 07:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6534b99-98b6-598f-8fb8-a237580317b5 with identifier: BX02893
2026-03-30 07:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6534b99-98b6-598f-8fb8-a237580317b5 with identifier: BX02893 to the API
2026-03-30 07:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:34:03Z',
 'fuel_type': 'petrol',
 'id': 'd6534b99-98b6-598f-8fb8-a237580317b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX02893',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 59619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX02893%27 HTTP/1.1" 200 None
2026-03-30 07:32:12 [auto1.de] INFO: Saving data for BX02893: {'auction_closing_time': 1774971243.0, 'created_time': 1773725428.699172, 'last_price_update_time': 1774855932.448592}
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX02893') HTTP/1.1" 204 0
2026-03-30 07:32:12 [auto1.de] INFO: Found listing with ID: TF97551
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF97551%27 HTTP/1.1" 200 None
2026-03-30 07:32:12 [auto1.de] INFO: Scrape type for TF97551: 1
2026-03-30 07:32:12 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-30 07:32:12 [auto1.de] INFO: Scrape type for UW91893: 2
2026-03-30 07:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-30 07:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with scrape type 2
2026-03-30 07:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with scrape type 2
2026-03-30 07:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93, identifier: UW91893
2026-03-30 07:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ90334> (referer: https://www.auto1.com/v1/car-details-view/LZ90334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-30 07:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-30 07:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893 to the API
2026-03-30 07:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:49:16Z',
 'fuel_type': 'diesel',
 'id': 'e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW91893',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 207720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-30 07:32:14 [auto1.de] INFO: Saving data for UW91893: {'auction_closing_time': 1774972156.0, 'created_time': 1773137303.542194, 'last_price_update_time': 1774855934.68463}
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW91893') HTTP/1.1" 204 0
2026-03-30 07:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca80450>
2026-03-30 07:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_3151abe59f8b201f8515a5828b57f07f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_3151abe59f8b201f8515a5828b57f07f.jpg saved to cache
2026-03-30 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:14 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-30 07:32:14 [auto1.de] INFO: Found listing with ID: HH96934
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH96934%27 HTTP/1.1" 200 None
2026-03-30 07:32:14 [auto1.de] INFO: Scrape type for HH96934: 2
2026-03-30 07:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbf6003-90e9-5209-9f09-69799126a3cb with identifier: HH96934
2026-03-30 07:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbf6003-90e9-5209-9f09-69799126a3cb with scrape type 2
2026-03-30 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbf6003-90e9-5209-9f09-69799126a3cb with scrape type 2
2026-03-30 07:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bbf6003-90e9-5209-9f09-69799126a3cb, identifier: HH96934
2026-03-30 07:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bbf6003-90e9-5209-9f09-69799126a3cb with identifier: HH96934
2026-03-30 07:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bbf6003-90e9-5209-9f09-69799126a3cb with identifier: HH96934
2026-03-30 07:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bbf6003-90e9-5209-9f09-69799126a3cb with identifier: HH96934 to the API
2026-03-30 07:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:53:06Z',
 'fuel_type': 'petrol',
 'id': '0bbf6003-90e9-5209-9f09-69799126a3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH96934',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 134494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH96934%27 HTTP/1.1" 200 None
2026-03-30 07:32:15 [auto1.de] INFO: Saving data for HH96934: {'auction_closing_time': 1774972386.0, 'created_time': 1773773397.135518, 'last_price_update_time': 1774855935.338112}
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH96934') HTTP/1.1" 204 0
2026-03-30 07:32:15 [auto1.de] INFO: Found listing with ID: YR25521
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25521%27 HTTP/1.1" 200 None
2026-03-30 07:32:15 [auto1.de] INFO: Scrape type for YR25521: 2
2026-03-30 07:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70cf498-3455-5182-9c8d-495a52c100e6 with identifier: YR25521
2026-03-30 07:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70cf498-3455-5182-9c8d-495a52c100e6 with scrape type 2
2026-03-30 07:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70cf498-3455-5182-9c8d-495a52c100e6 with scrape type 2
2026-03-30 07:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c70cf498-3455-5182-9c8d-495a52c100e6, identifier: YR25521
2026-03-30 07:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL52621> (referer: https://www.auto1.com/v1/car-details-view/EL52621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD78216> (referer: https://www.auto1.com/v1/car-details-view/AD78216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c70cf498-3455-5182-9c8d-495a52c100e6 with identifier: YR25521
2026-03-30 07:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c70cf498-3455-5182-9c8d-495a52c100e6 with identifier: YR25521
2026-03-30 07:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c70cf498-3455-5182-9c8d-495a52c100e6 with identifier: YR25521 to the API
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:40:02Z',
 'fuel_type': 'diesel',
 'id': 'c70cf498-3455-5182-9c8d-495a52c100e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR25521',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 170081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2017}
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25521%27 HTTP/1.1" 200 None
2026-03-30 07:32:15 [auto1.de] INFO: Saving data for YR25521: {'auction_closing_time': 1774971602.0, 'created_time': 1773775440.238643, 'last_price_update_time': 1774855935.962546}
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR25521') HTTP/1.1" 204 0
2026-03-30 07:32:15 [auto1.de] INFO: Found listing with ID: TF02726
2026-03-30 07:32:15 [auto1.de] INFO: Found listing with ID: RE43747
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE43747%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [auto1.de] INFO: Scrape type for RE43747: 1
2026-03-30 07:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd85ac2-de22-54ad-956e-2815d491103b with identifier: LZ90334
2026-03-30 07:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd85ac2-de22-54ad-956e-2815d491103b with scrape type 1
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fd85ac2-de22-54ad-956e-2815d491103b
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_c97743ec1e66ccbde385824bd8c3630a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_c97743ec1e66ccbde385824bd8c3630a.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_56f3a8a2f294f147d7bf9e8d01213ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_56f3a8a2f294f147d7bf9e8d01213ee3.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_2bf6aac3c37fbc43b90e5300ad6b797c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_2bf6aac3c37fbc43b90e5300ad6b797c.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_23c0e5b71caabef379fa07b73eeaaa37.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_23c0e5b71caabef379fa07b73eeaaa37.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_a4d7006b0b8795db3e6ea036fc0e0efe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_a4d7006b0b8795db3e6ea036fc0e0efe.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_9c97a1a4c714031515b4bac8ab068dbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_9c97a1a4c714031515b4bac8ab068dbf.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_970fa589b08a0539867bb7ddd135a89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_970fa589b08a0539867bb7ddd135a89d.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_7e3a60d13b32b15df5c8ae7931fa75d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_7e3a60d13b32b15df5c8ae7931fa75d1.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_d327d6e0dcf964af9f9fb3996938bd39.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_d327d6e0dcf964af9f9fb3996938bd39.jpg already downloaded
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3c%252F2e3cc72f008472bee07795f8104d74b6%252Fpa%252FLZ90334_834fd727cd06bcee4fff9294848b6fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_834fd727cd06bcee4fff9294848b6fa3.jpg already downloaded
2026-03-30 07:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd85ac2-de22-54ad-956e-2815d491103b, identifier: LZ90334
2026-03-30 07:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd85ac2-de22-54ad-956e-2815d491103b with identifier: LZ90334
2026-03-30 07:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd85ac2-de22-54ad-956e-2815d491103b with identifier: LZ90334
2026-03-30 07:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd85ac2-de22-54ad-956e-2815d491103b with identifier: LZ90334 to the API
2026-03-30 07:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ90334>
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 2',
 'engine': '2.8L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:46:20Z',
 'fuel_type': 'petrol',
 'id': '5fd85ac2-de22-54ad-956e-2815d491103b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ90334',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'BMW',
 'model': 'Z3',
 'odometer': 206498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_c97743ec1e66ccbde385824bd8c3630a.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_56f3a8a2f294f147d7bf9e8d01213ee3.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_2bf6aac3c37fbc43b90e5300ad6b797c.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_23c0e5b71caabef379fa07b73eeaaa37.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_a4d7006b0b8795db3e6ea036fc0e0efe.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_9c97a1a4c714031515b4bac8ab068dbf.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_970fa589b08a0539867bb7ddd135a89d.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_7e3a60d13b32b15df5c8ae7931fa75d1.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_d327d6e0dcf964af9f9fb3996938bd39.jpg',
                'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_834fd727cd06bcee4fff9294848b6fa3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_c97743ec1e66ccbde385824bd8c3630a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_56f3a8a2f294f147d7bf9e8d01213ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_2bf6aac3c37fbc43b90e5300ad6b797c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_23c0e5b71caabef379fa07b73eeaaa37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_a4d7006b0b8795db3e6ea036fc0e0efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_9c97a1a4c714031515b4bac8ab068dbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_970fa589b08a0539867bb7ddd135a89d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_7e3a60d13b32b15df5c8ae7931fa75d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_d327d6e0dcf964af9f9fb3996938bd39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd85ac2-de22-54ad-956e-2815d491103b/5fd85ac2-de22-54ad-956e-2815d491103b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3c/2e3cc72f008472bee07795f8104d74b6/pa/LZ90334_834fd727cd06bcee4fff9294848b6fa3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1997-08-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z3 2.8',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ90334%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [auto1.de] INFO: Saving data for LZ90334: {'created_time': 1774855937.771521, 'last_price_update_time': 1774855937.771537, 'auction_closing_time': 1774971980.0}
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ90334') HTTP/1.1" 204 0
2026-03-30 07:32:17 [auto1.de] INFO: Found listing with ID: HG84341
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG84341%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [auto1.de] INFO: Scrape type for HG84341: 1
2026-03-30 07:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ06926> (referer: https://www.auto1.com/v1/car-details-view/DJ06926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61bb0b0d-58d7-5c8c-9246-fb3094464520 with identifier: EL52621
2026-03-30 07:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61bb0b0d-58d7-5c8c-9246-fb3094464520 with scrape type 1
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61bb0b0d-58d7-5c8c-9246-fb3094464520
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_88638e6c88144cd1ae8cf7945d6a3b25.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_88638e6c88144cd1ae8cf7945d6a3b25.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_31e21064804ed7686fcc7b80bf83e844.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_31e21064804ed7686fcc7b80bf83e844.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_8fdbab38f250eb25cc7da80356dbce13.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_8fdbab38f250eb25cc7da80356dbce13.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_c2ddd41d9cbc39b669e6efc51f933a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c2ddd41d9cbc39b669e6efc51f933a5e.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_2167f4f57f74faa2fc43ee9a1c72b0ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_2167f4f57f74faa2fc43ee9a1c72b0ee.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_fb81ebd194a817a4add2e50c92041e95.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fb81ebd194a817a4add2e50c92041e95.jpg already downloaded
2026-03-30 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_c795fd7aa16fa6bac225f7c2cef0da2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c795fd7aa16fa6bac225f7c2cef0da2e.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_ebde30ab58beab0ab67321ab6c039f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_ebde30ab58beab0ab67321ab6c039f0b.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_7ff6d1dd9d83434cfdbd2f916e29fdb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_7ff6d1dd9d83434cfdbd2f916e29fdb0.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fd6%252F27d6613e492998071ae5817b745e3025%252Fpa%252FEL52621_fe88b1dc2d4f545eeebe554a7c1201b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fe88b1dc2d4f545eeebe554a7c1201b4.jpg already downloaded
2026-03-30 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61bb0b0d-58d7-5c8c-9246-fb3094464520, identifier: EL52621
2026-03-30 07:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5129afb2-791d-5688-ab1b-009432c4ae2e with identifier: AD78216
2026-03-30 07:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5129afb2-791d-5688-ab1b-009432c4ae2e with scrape type 1
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5129afb2-791d-5688-ab1b-009432c4ae2e
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_1ad7552af1b9ca3e1705f0c41dfa8297.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1ad7552af1b9ca3e1705f0c41dfa8297.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_cde87d4765f8b452e15d6fd5ffcbe284.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_cde87d4765f8b452e15d6fd5ffcbe284.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_52853804bfb5bb8a51c7c6eac8a1f539.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_52853804bfb5bb8a51c7c6eac8a1f539.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_bd757d00bdddfeae68b33ad62ee95b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_bd757d00bdddfeae68b33ad62ee95b76.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_d60cf5ab8a12b8d7d995d76836d60cf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d60cf5ab8a12b8d7d995d76836d60cf4.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_d32f33d98b6c425227183c301538b912.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d32f33d98b6c425227183c301538b912.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_93a7fd42332640f6eb48456881c097c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_93a7fd42332640f6eb48456881c097c4.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_7e13b5ff00fc480be846f31d51603c5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_7e13b5ff00fc480be846f31d51603c5c.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_4de7a95915be57e9a50182ea8351db4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_4de7a95915be57e9a50182ea8351db4d.jpg already downloaded
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F99%252F1899c0ba3a697deb96e42f1bd4a33f33%252Fpa%252FAD78216_1d70c55e363cbf972ee9d37425a4d1ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1d70c55e363cbf972ee9d37425a4d1ea.jpg already downloaded
2026-03-30 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5129afb2-791d-5688-ab1b-009432c4ae2e, identifier: AD78216
2026-03-30 07:32:18 [auto1.de] INFO: Found listing with ID: KJ12622
2026-03-30 07:32:18 [auto1.de] INFO: Found listing with ID: MB78581
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB78581%27 HTTP/1.1" 200 None
2026-03-30 07:32:18 [auto1.de] INFO: Scrape type for MB78581: 1
2026-03-30 07:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB29861> (referer: https://www.auto1.com/v1/car-details-view/ZB29861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61bb0b0d-58d7-5c8c-9246-fb3094464520 with identifier: EL52621
2026-03-30 07:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61bb0b0d-58d7-5c8c-9246-fb3094464520 with identifier: EL52621
2026-03-30 07:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61bb0b0d-58d7-5c8c-9246-fb3094464520 with identifier: EL52621 to the API
2026-03-30 07:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL52621>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:02:26Z',
 'fuel_type': 'diesel',
 'id': '61bb0b0d-58d7-5c8c-9246-fb3094464520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL52621',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'BMW',
 'model': '5er',
 'odometer': 481978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_88638e6c88144cd1ae8cf7945d6a3b25.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_31e21064804ed7686fcc7b80bf83e844.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_8fdbab38f250eb25cc7da80356dbce13.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c2ddd41d9cbc39b669e6efc51f933a5e.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_2167f4f57f74faa2fc43ee9a1c72b0ee.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fb81ebd194a817a4add2e50c92041e95.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c795fd7aa16fa6bac225f7c2cef0da2e.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_ebde30ab58beab0ab67321ab6c039f0b.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_7ff6d1dd9d83434cfdbd2f916e29fdb0.jpg',
                'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fe88b1dc2d4f545eeebe554a7c1201b4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_88638e6c88144cd1ae8cf7945d6a3b25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_31e21064804ed7686fcc7b80bf83e844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_8fdbab38f250eb25cc7da80356dbce13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c2ddd41d9cbc39b669e6efc51f933a5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_2167f4f57f74faa2fc43ee9a1c72b0ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fb81ebd194a817a4add2e50c92041e95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_c795fd7aa16fa6bac225f7c2cef0da2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_ebde30ab58beab0ab67321ab6c039f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_7ff6d1dd9d83434cfdbd2f916e29fdb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bb0b0d-58d7-5c8c-9246-fb3094464520/61bb0b0d-58d7-5c8c-9246-fb3094464520_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/d6/27d6613e492998071ae5817b745e3025/pa/EL52621_fe88b1dc2d4f545eeebe554a7c1201b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 535d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL52621%27 HTTP/1.1" 200 None
2026-03-30 07:32:19 [auto1.de] INFO: Saving data for EL52621: {'created_time': 1774855939.451452, 'last_price_update_time': 1774855939.451465, 'auction_closing_time': 1774969346.0}
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL52621') HTTP/1.1" 204 0
2026-03-30 07:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5129afb2-791d-5688-ab1b-009432c4ae2e with identifier: AD78216
2026-03-30 07:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5129afb2-791d-5688-ab1b-009432c4ae2e with identifier: AD78216
2026-03-30 07:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5129afb2-791d-5688-ab1b-009432c4ae2e with identifier: AD78216 to the API
2026-03-30 07:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD78216>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:33:44Z',
 'fuel_type': 'petrol',
 'id': '5129afb2-791d-5688-ab1b-009432c4ae2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD78216',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 300643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1ad7552af1b9ca3e1705f0c41dfa8297.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_cde87d4765f8b452e15d6fd5ffcbe284.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_52853804bfb5bb8a51c7c6eac8a1f539.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_bd757d00bdddfeae68b33ad62ee95b76.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d60cf5ab8a12b8d7d995d76836d60cf4.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d32f33d98b6c425227183c301538b912.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_93a7fd42332640f6eb48456881c097c4.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_7e13b5ff00fc480be846f31d51603c5c.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_4de7a95915be57e9a50182ea8351db4d.jpg',
                'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1d70c55e363cbf972ee9d37425a4d1ea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2080215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1ad7552af1b9ca3e1705f0c41dfa8297.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1982901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_cde87d4765f8b452e15d6fd5ffcbe284.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_52853804bfb5bb8a51c7c6eac8a1f539.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_bd757d00bdddfeae68b33ad62ee95b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1996385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d60cf5ab8a12b8d7d995d76836d60cf4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_d32f33d98b6c425227183c301538b912.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_93a7fd42332640f6eb48456881c097c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2061102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_7e13b5ff00fc480be846f31d51603c5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2020829,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_4de7a95915be57e9a50182ea8351db4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5129afb2-791d-5688-ab1b-009432c4ae2e/5129afb2-791d-5688-ab1b-009432c4ae2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/99/1899c0ba3a697deb96e42f1bd4a33f33/pa/AD78216_1d70c55e363cbf972ee9d37425a4d1ea.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD78216%27 HTTP/1.1" 200 None
2026-03-30 07:32:21 [auto1.de] INFO: Saving data for AD78216: {'created_time': 1774855941.244597, 'last_price_update_time': 1774855941.244609, 'auction_closing_time': 1774971224.0}
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD78216') HTTP/1.1" 204 0
2026-03-30 07:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:21 [auto1.de] INFO: Found listing with ID: BP06971
2026-03-30 07:32:21 [auto1.de] INFO: Found listing with ID: ET95564
2026-03-30 07:32:21 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-30 07:32:21 [auto1.de] INFO: Found listing with ID: KP65433
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP65433%27 HTTP/1.1" 200 None
2026-03-30 07:32:21 [auto1.de] INFO: Scrape type for KP65433: 2
2026-03-30 07:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48eed961-7026-5361-8445-de95b3614d28 with identifier: KP65433
2026-03-30 07:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48eed961-7026-5361-8445-de95b3614d28 with scrape type 2
2026-03-30 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48eed961-7026-5361-8445-de95b3614d28 with scrape type 2
2026-03-30 07:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48eed961-7026-5361-8445-de95b3614d28, identifier: KP65433
2026-03-30 07:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF97551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48eed961-7026-5361-8445-de95b3614d28 with identifier: KP65433
2026-03-30 07:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48eed961-7026-5361-8445-de95b3614d28 with identifier: KP65433
2026-03-30 07:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48eed961-7026-5361-8445-de95b3614d28 with identifier: KP65433 to the API
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:13Z',
 'fuel_type': 'diesel',
 'id': '48eed961-7026-5361-8445-de95b3614d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP65433',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 156684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP65433%27 HTTP/1.1" 200 None
2026-03-30 07:32:21 [auto1.de] INFO: Saving data for KP65433: {'auction_closing_time': 1774971973.0, 'created_time': 1773775471.833602, 'last_price_update_time': 1774855941.819962}
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP65433') HTTP/1.1" 204 0
2026-03-30 07:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d60fbac1-449e-5f39-9467-a1159973cdf7 with identifier: DJ06926
2026-03-30 07:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60fbac1-449e-5f39-9467-a1159973cdf7 with scrape type 1
2026-03-30 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg not downloaded yet
2026-03-30 07:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d993d6e-f100-59cb-9d3b-857947166a04 with identifier: ZB29861
2026-03-30 07:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d993d6e-f100-59cb-9d3b-857947166a04 with scrape type 1
2026-03-30 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg not downloaded yet
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG83409%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [auto1.de] INFO: Scrape type for VG83409: 1
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_d783d0161a274987caa6682bee26a3f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d783d0161a274987caa6682bee26a3f0.jpg not downloaded yet
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg not downloaded yet
2026-03-30 07:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17470%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [auto1.de] INFO: Scrape type for XD17470: 2
2026-03-30 07:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fccec4-3223-5708-b5bc-a6c1b61daa0b with identifier: XD17470
2026-03-30 07:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fccec4-3223-5708-b5bc-a6c1b61daa0b with scrape type 2
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fccec4-3223-5708-b5bc-a6c1b61daa0b with scrape type 2
2026-03-30 07:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fccec4-3223-5708-b5bc-a6c1b61daa0b, identifier: XD17470
2026-03-30 07:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fccec4-3223-5708-b5bc-a6c1b61daa0b with identifier: XD17470
2026-03-30 07:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fccec4-3223-5708-b5bc-a6c1b61daa0b with identifier: XD17470
2026-03-30 07:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fccec4-3223-5708-b5bc-a6c1b61daa0b with identifier: XD17470 to the API
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:23:20Z',
 'fuel_type': 'diesel',
 'id': '15fccec4-3223-5708-b5bc-a6c1b61daa0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD17470',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 253718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2021}
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17470%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [auto1.de] INFO: Saving data for XD17470: {'auction_closing_time': 1774970600.0, 'created_time': 1774552602.746398, 'last_price_update_time': 1774855942.694013}
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD17470') HTTP/1.1" 204 0
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg not downloaded yet
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_12ea2df842a158112117dfb651e9008f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_12ea2df842a158112117dfb651e9008f.jpg not downloaded yet
2026-03-30 07:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7427d0>
2026-03-30 07:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg saved to cache
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:22 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN61491%27 HTTP/1.1" 200 None
2026-03-30 07:32:22 [auto1.de] INFO: Scrape type for FN61491: 2
2026-03-30 07:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with identifier: FN61491
2026-03-30 07:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with scrape type 2
2026-03-30 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with scrape type 2
2026-03-30 07:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21d8eba3-c1bb-5e41-92f3-eebf1054cd72, identifier: FN61491
2026-03-30 07:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with identifier: FN61491
2026-03-30 07:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with identifier: FN61491
2026-03-30 07:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21d8eba3-c1bb-5e41-92f3-eebf1054cd72 with identifier: FN61491 to the API
2026-03-30 07:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:32:57Z',
 'fuel_type': 'petrol',
 'id': '21d8eba3-c1bb-5e41-92f3-eebf1054cd72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN61491',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 62900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN61491%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [auto1.de] INFO: Saving data for FN61491: {'auction_closing_time': 1774971177.0, 'created_time': 1774294300.824131, 'last_price_update_time': 1774855944.665136}
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN61491') HTTP/1.1" 204 0
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg not downloaded yet
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_951b4c929d1252d52c5778a612e7f82b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_951b4c929d1252d52c5778a612e7f82b.jpg not downloaded yet
2026-03-30 07:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP15828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc815150>
2026-03-30 07:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg saved to cache
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:24 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 07:32:24 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 07:32:24 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 07:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD29935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_d565f54db859daf69cdc75251251f59e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d565f54db859daf69cdc75251251f59e.jpg not downloaded yet
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_433b8c49f0c87f3ff327b2688016bace.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_433b8c49f0c87f3ff327b2688016bace.jpg not downloaded yet
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg not downloaded yet
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_0e76c0aeaf8a30df420c87118779d828.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_0e76c0aeaf8a30df420c87118779d828.jpg not downloaded yet
2026-03-30 07:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_b72275631ee6310c2b435e6f05109267.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b72275631ee6310c2b435e6f05109267.jpg not downloaded yet
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_a88e542af1b93ce53680201aaf74cf35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_a88e542af1b93ce53680201aaf74cf35.jpg not downloaded yet
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_3a5208b855e1d818aa18d83b70981a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_3a5208b855e1d818aa18d83b70981a26.jpg not downloaded yet
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg not downloaded yet
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_fead7b6b8b28544af62e7543cff893dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_fead7b6b8b28544af62e7543cff893dd.jpg not downloaded yet
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg not downloaded yet
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_1f2830fc392c43cdba93253f5ad29842.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0bbb890f1caf2417bee1aec797953054.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg not downloaded yet
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_91be5cdacf81e513569790d33f883592.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_91be5cdacf81e513569790d33f883592.jpg not downloaded yet
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc589dd0>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_12ea2df842a158112117dfb651e9008f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_bc63506b4d74020d876f498730347eee.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc872010>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_1f2830fc392c43cdba93253f5ad29842.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_1f2830fc392c43cdba93253f5ad29842.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc740950>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca50550>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_0bbb890f1caf2417bee1aec797953054.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0bbb890f1caf2417bee1aec797953054.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_951b4c929d1252d52c5778a612e7f82b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_0e76c0aeaf8a30df420c87118779d828.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca5b050>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_12ea2df842a158112117dfb651e9008f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_12ea2df842a158112117dfb651e9008f.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beae8350>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_bc63506b4d74020d876f498730347eee.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_bc63506b4d74020d876f498730347eee.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_017370993409338ade27f6c9cfb1a16c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG84341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c3a10>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_951b4c929d1252d52c5778a612e7f82b.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_951b4c929d1252d52c5778a612e7f82b.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b1ed0>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_0e76c0aeaf8a30df420c87118779d828.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_0e76c0aeaf8a30df420c87118779d828.jpg saved to cache
2026-03-30 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_91be5cdacf81e513569790d33f883592.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE43747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7480d0>
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_017370993409338ade27f6c9cfb1a16c.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_017370993409338ade27f6c9cfb1a16c.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_a88e542af1b93ce53680201aaf74cf35.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF97551> (referer: https://www.auto1.com/v1/car-details-view/TF97551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8f5590>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_91be5cdacf81e513569790d33f883592.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_91be5cdacf81e513569790d33f883592.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc884ed0>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc697bd0>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_3a5208b855e1d818aa18d83b70981a26.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_fead7b6b8b28544af62e7543cff893dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_433b8c49f0c87f3ff327b2688016bace.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b72275631ee6310c2b435e6f05109267.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3e3b10>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_a88e542af1b93ce53680201aaf74cf35.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_a88e542af1b93ce53680201aaf74cf35.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc95c750>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:26 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 7293 | hits on page: 40
2026-03-30 07:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with identifier: TF97551
2026-03-30 07:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with scrape type 1
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_ea41d0f28b48742c5a0f7388251b7501.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_ea41d0f28b48742c5a0f7388251b7501.jpg not downloaded yet
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: TF97551
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_3d63808c6df801f8669d04518749a9ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3d63808c6df801f8669d04518749a9ae.jpg not downloaded yet
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc33b590>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc54e250>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_3a5208b855e1d818aa18d83b70981a26.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_3a5208b855e1d818aa18d83b70981a26.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6fabd0>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_fead7b6b8b28544af62e7543cff893dd.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_fead7b6b8b28544af62e7543cff893dd.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6a9490>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7427d0>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_433b8c49f0c87f3ff327b2688016bace.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_433b8c49f0c87f3ff327b2688016bace.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2e0890>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_b72275631ee6310c2b435e6f05109267.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b72275631ee6310c2b435e6f05109267.jpg saved to cache
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d565f54db859daf69cdc75251251f59e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d783d0161a274987caa6682bee26a3f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [auto1.de] INFO: Scrape type for UW91893: 0
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: HH96934
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH96934%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [auto1.de] INFO: Scrape type for HH96934: 0
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: YR25521
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25521%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [auto1.de] INFO: Scrape type for YR25521: 0
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: TF02726
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: RE43747
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_544f63896a54fbe782a31cd135d5161f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_544f63896a54fbe782a31cd135d5161f.jpg not downloaded yet
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:26 [auto1.de] INFO: Found listing with ID: HG84341
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_5cfad68917d6bc93cd01743946a58ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_5cfad68917d6bc93cd01743946a58ea1.jpg not downloaded yet
2026-03-30 07:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB78581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2c2f10>
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be8262d0>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beb11910>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: KJ12622
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: MB78581
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg not downloaded yet
2026-03-30 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_b36ba752e1470f11df997f6d887d81c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7aac10>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_d565f54db859daf69cdc75251251f59e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d565f54db859daf69cdc75251251f59e.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4763d0>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_d783d0161a274987caa6682bee26a3f0.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d783d0161a274987caa6682bee26a3f0.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: BP06971
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: ET95564
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: KP65433
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP65433%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [auto1.de] INFO: Scrape type for KP65433: 0
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg not downloaded yet
2026-03-30 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP15828> (referer: https://www.auto1.com/v1/car-details-view/EP15828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD29935> (referer: https://www.auto1.com/v1/car-details-view/CD29935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_ea41d0f28b48742c5a0f7388251b7501.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD17470%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [auto1.de] INFO: Scrape type for XD17470: 0
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN61491%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [auto1.de] INFO: Scrape type for FN61491: 0
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 07:32:27 [auto1.de] INFO: Found listing with ID: DP33373
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP33373%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [auto1.de] INFO: Scrape type for DP33373: 2
2026-03-30 07:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with identifier: DP33373
2026-03-30 07:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with scrape type 2
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with scrape type 2
2026-03-30 07:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef5d6f62-0473-5c3e-a61a-8e1d2f991c12, identifier: DP33373
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_26c0a7c901cdc22e343cbd675141d46e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_26c0a7c901cdc22e343cbd675141d46e.jpg not downloaded yet
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c1a90>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc685c50>
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F77%252Fd07719a1093654ed932a7f50a93a7823%252Fpa%252FDJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg saved to cache
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d60fbac1-449e-5f39-9467-a1159973cdf7
2026-03-30 07:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d60fbac1-449e-5f39-9467-a1159973cdf7, skipping ID generation
2026-03-30 07:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60fbac1-449e-5f39-9467-a1159973cdf7 with scrape type 1
2026-03-30 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d60fbac1-449e-5f39-9467-a1159973cdf7 sending to next pipeline
2026-03-30 07:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d60fbac1-449e-5f39-9467-a1159973cdf7, identifier: DJ06926
2026-03-30 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7b2834216158a13c5689d23f9b7cafa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with identifier: DP33373
2026-03-30 07:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with identifier: DP33373
2026-03-30 07:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef5d6f62-0473-5c3e-a61a-8e1d2f991c12 with identifier: DP33373 to the API
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:39Z',
 'fuel_type': 'petrol',
 'id': 'ef5d6f62-0473-5c3e-a61a-8e1d2f991c12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP33373',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 52986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP33373%27 HTTP/1.1" 200 None
2026-03-30 07:32:28 [auto1.de] INFO: Saving data for DP33373: {'auction_closing_time': 1774971579.0, 'created_time': 1773346053.501629, 'last_price_update_time': 1774855948.510733}
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP33373') HTTP/1.1" 204 0
2026-03-30 07:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d60fbac1-449e-5f39-9467-a1159973cdf7 with identifier: DJ06926
2026-03-30 07:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d60fbac1-449e-5f39-9467-a1159973cdf7 with identifier: DJ06926
2026-03-30 07:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d60fbac1-449e-5f39-9467-a1159973cdf7 with identifier: DJ06926 to the API
2026-03-30 07:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:55:49Z',
 'fuel_type': 'petrol',
 'id': 'd60fbac1-449e-5f39-9467-a1159973cdf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ06926',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': '1er',
 'odometer': 87627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_456a7fe5f1dbcd677403a09459aa3d07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d783d0161a274987caa6682bee26a3f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_53ca49fb26a301f6f2f64668c48d0062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b2fe8b5e1665337b6502ee2fc5cf32fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_d565f54db859daf69cdc75251251f59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_350aec7ab213bddd3b47091a96a8dd89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_b72275631ee6310c2b435e6f05109267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_3a5208b855e1d818aa18d83b70981a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_fead7b6b8b28544af62e7543cff893dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60fbac1-449e-5f39-9467-a1159973cdf7/d60fbac1-449e-5f39-9467-a1159973cdf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/77/d07719a1093654ed932a7f50a93a7823/pa/DJ06926_360ef953937e0e5ee0f022e80c9f10a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ06926%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [auto1.de] INFO: Saving data for DJ06926: {'created_time': 1774855949.302041, 'last_price_update_time': 1774855949.302056, 'auction_closing_time': 1774972549.0}
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ06926') HTTP/1.1" 204 0
2026-03-30 07:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:29 [auto1.de] INFO: Found listing with ID: RS49275
2026-03-30 07:32:29 [auto1.de] INFO: Found listing with ID: NT12498
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT12498%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [auto1.de] INFO: Scrape type for NT12498: 1
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg not downloaded yet
2026-03-30 07:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG84341> (referer: https://www.auto1.com/v1/car-details-view/HG84341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3d63808c6df801f8669d04518749a9ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_544f63896a54fbe782a31cd135d5161f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG83409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE43747> (referer: https://www.auto1.com/v1/car-details-view/RE43747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc83ce50>
2026-03-30 07:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F3e%252Fd73e9d9787a130433c6c09c6e1b0b865%252Fpa%252FCD25494_b36ba752e1470f11df997f6d887d81c8.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_b36ba752e1470f11df997f6d887d81c8.jpg saved to cache
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712
2026-03-30 07:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aa5f63c-b12d-53c3-9cf0-ea4300612712, skipping ID generation
2026-03-30 07:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with scrape type 1
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aa5f63c-b12d-53c3-9cf0-ea4300612712 sending to next pipeline
2026-03-30 07:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aa5f63c-b12d-53c3-9cf0-ea4300612712, identifier: CD25494
2026-03-30 07:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4628070-4ddb-511d-b8e3-1e93c7b5ccf5 with identifier: EP15828
2026-03-30 07:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4628070-4ddb-511d-b8e3-1e93c7b5ccf5 with scrape type 1
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e4628070-4ddb-511d-b8e3-1e93c7b5ccf5
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d33243c12c775b9bcedeae94bf780%252Fpa%252FEP15828_3f26b66e9d01b840a6679453d5aa0b41.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f26b66e9d01b840a6679453d5aa0b41.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d33243c12c775b9bcedeae94bf780%252Fpa%252FEP15828_55b770d952e7331fa3011f62cb77b1ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_55b770d952e7331fa3011f62cb77b1ed.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d33243c12c775b9bcedeae94bf780%252Fpa%252FEP15828_9fbe73c7b111af104cf77a6d6d41c6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_9fbe73c7b111af104cf77a6d6d41c6c7.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d33243c12c775b9bcedeae94bf780%252Fpa%252FEP15828_3f0886f80a2082fcbb68aa16d29418cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f0886f80a2082fcbb68aa16d29418cf.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9d%252F9b9d33243c12c775b9bcedeae94bf780%252Fpa%252FEP15828_c7f631152f2b5035d931101105c0a3f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_c7f631152f2b5035d931101105c0a3f6.jpg already downloaded
2026-03-30 07:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4628070-4ddb-511d-b8e3-1e93c7b5ccf5, identifier: EP15828
2026-03-30 07:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090 with identifier: CD29935
2026-03-30 07:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090 with scrape type 1
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_bb2575523cd186fe248430d8da2fbede.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_bb2575523cd186fe248430d8da2fbede.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_1f4cc14f34789465524ac25d39e10805.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_1f4cc14f34789465524ac25d39e10805.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_46688aa98dedbb30cd9411b05423f49d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_46688aa98dedbb30cd9411b05423f49d.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_c0e4159bf6dd865ba66d1f863691cfa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_c0e4159bf6dd865ba66d1f863691cfa2.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_e925eb040d9cb47ed213d2a5bf90e92c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_e925eb040d9cb47ed213d2a5bf90e92c.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_cae28a60e871793c3b33973327fd48a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_cae28a60e871793c3b33973327fd48a1.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_068296abf0f2f442e70ac726770b9758.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_068296abf0f2f442e70ac726770b9758.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_41160169d095949491d20719f1b9d061.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_41160169d095949491d20719f1b9d061.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_ff1282137dd1e1dc8532b0737112df5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ff1282137dd1e1dc8532b0737112df5c.jpg already downloaded
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F2b%252F942bac695e4976000e5ac8599c2e5177%252Fpa%252FCD29935_ce58ee53b176069887cfa205b598dd0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ce58ee53b176069887cfa205b598dd0a.jpg already downloaded
2026-03-30 07:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090, identifier: CD29935
2026-03-30 07:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc675e90>
2026-03-30 07:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_ea41d0f28b48742c5a0f7388251b7501.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_ea41d0f28b48742c5a0f7388251b7501.jpg saved to cache
2026-03-30 07:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_5cfad68917d6bc93cd01743946a58ea1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:30 [auto1.de] INFO: Found listing with ID: AF38150
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF38150%27 HTTP/1.1" 200 None
2026-03-30 07:32:30 [auto1.de] INFO: Scrape type for AF38150: 2
2026-03-30 07:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb08b070-4e49-582b-acb1-e7bb27256805 with identifier: AF38150
2026-03-30 07:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb08b070-4e49-582b-acb1-e7bb27256805 with scrape type 2
2026-03-30 07:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb08b070-4e49-582b-acb1-e7bb27256805 with scrape type 2
2026-03-30 07:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb08b070-4e49-582b-acb1-e7bb27256805, identifier: AF38150
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg not downloaded yet
2026-03-30 07:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with identifier: CD25494
2026-03-30 07:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with identifier: CD25494
2026-03-30 07:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aa5f63c-b12d-53c3-9cf0-ea4300612712 with identifier: CD25494 to the API
2026-03-30 07:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_b36ba752e1470f11df997f6d887d81c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:51:33Z',
 'fuel_type': 'diesel',
 'id': '0aa5f63c-b12d-53c3-9cf0-ea4300612712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD25494',
 'listing': 'auction',
 'location': 'DE, Sinzheim',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 144143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8359b5f1f160993d08ba6c76a0b26431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_b36ba752e1470f11df997f6d887d81c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_5a61468fa9c824c85855b43327e8e88e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_faadc10c2e8c24b2516ababe6988b1bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_1cb42098c3ddda4d75d574f77d8aa3aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_8f1e31f21990cf9ef431cbcef4d1b3ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_bae71e1958ea9b73117a77bef0ff4925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_96b1dcd0224a8a59f2197cdb4876529f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_577cd8f544a819653b22d0e249470c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa5f63c-b12d-53c3-9cf0-ea4300612712/0aa5f63c-b12d-53c3-9cf0-ea4300612712_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/3e/d73e9d9787a130433c6c09c6e1b0b865/pa/CD25494_7b6790fb946098ba613245d5fb2076e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD25494%27 HTTP/1.1" 200 None
2026-03-30 07:32:31 [auto1.de] INFO: Saving data for CD25494: {'created_time': 1774855951.528514, 'last_price_update_time': 1774855951.528526, 'auction_closing_time': 1774972293.0}
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD25494') HTTP/1.1" 204 0
2026-03-30 07:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4628070-4ddb-511d-b8e3-1e93c7b5ccf5 with identifier: EP15828
2026-03-30 07:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4628070-4ddb-511d-b8e3-1e93c7b5ccf5 with identifier: EP15828
2026-03-30 07:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4628070-4ddb-511d-b8e3-1e93c7b5ccf5 with identifier: EP15828 to the API
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP15828>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:22:20Z',
 'fuel_type': 'petrol',
 'id': 'e4628070-4ddb-511d-b8e3-1e93c7b5ccf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP15828',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 152257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f26b66e9d01b840a6679453d5aa0b41.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_55b770d952e7331fa3011f62cb77b1ed.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_9fbe73c7b111af104cf77a6d6d41c6c7.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f0886f80a2082fcbb68aa16d29418cf.jpg',
                'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_c7f631152f2b5035d931101105c0a3f6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4628070-4ddb-511d-b8e3-1e93c7b5ccf5/e4628070-4ddb-511d-b8e3-1e93c7b5ccf5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f26b66e9d01b840a6679453d5aa0b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4628070-4ddb-511d-b8e3-1e93c7b5ccf5/e4628070-4ddb-511d-b8e3-1e93c7b5ccf5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_55b770d952e7331fa3011f62cb77b1ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4628070-4ddb-511d-b8e3-1e93c7b5ccf5/e4628070-4ddb-511d-b8e3-1e93c7b5ccf5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_9fbe73c7b111af104cf77a6d6d41c6c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4628070-4ddb-511d-b8e3-1e93c7b5ccf5/e4628070-4ddb-511d-b8e3-1e93c7b5ccf5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_3f0886f80a2082fcbb68aa16d29418cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4628070-4ddb-511d-b8e3-1e93c7b5ccf5/e4628070-4ddb-511d-b8e3-1e93c7b5ccf5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/9d/9b9d33243c12c775b9bcedeae94bf780/pa/EP15828_c7f631152f2b5035d931101105c0a3f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP15828%27 HTTP/1.1" 200 None
2026-03-30 07:32:32 [auto1.de] INFO: Saving data for EP15828: {'created_time': 1774855952.033013, 'last_price_update_time': 1774855952.033026, 'auction_closing_time': 1774970540.0}
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP15828') HTTP/1.1" 204 0
2026-03-30 07:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090 with identifier: CD29935
2026-03-30 07:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090 with identifier: CD29935
2026-03-30 07:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090 with identifier: CD29935 to the API
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD29935>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:16Z',
 'fuel_type': 'petrol',
 'id': 'f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD29935',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 17371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_bb2575523cd186fe248430d8da2fbede.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_1f4cc14f34789465524ac25d39e10805.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_46688aa98dedbb30cd9411b05423f49d.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_c0e4159bf6dd865ba66d1f863691cfa2.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_e925eb040d9cb47ed213d2a5bf90e92c.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_cae28a60e871793c3b33973327fd48a1.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_068296abf0f2f442e70ac726770b9758.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_41160169d095949491d20719f1b9d061.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ff1282137dd1e1dc8532b0737112df5c.jpg',
                'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ce58ee53b176069887cfa205b598dd0a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_bb2575523cd186fe248430d8da2fbede.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_1f4cc14f34789465524ac25d39e10805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_46688aa98dedbb30cd9411b05423f49d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_c0e4159bf6dd865ba66d1f863691cfa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_e925eb040d9cb47ed213d2a5bf90e92c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_cae28a60e871793c3b33973327fd48a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_068296abf0f2f442e70ac726770b9758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_41160169d095949491d20719f1b9d061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ff1282137dd1e1dc8532b0737112df5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090/f9ce8e2a-a6ce-5125-b9b4-e46eb9cd0090_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/2b/942bac695e4976000e5ac8599c2e5177/pa/CD29935_ce58ee53b176069887cfa205b598dd0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD29935%27 HTTP/1.1" 200 None
2026-03-30 07:32:32 [auto1.de] INFO: Saving data for CD29935: {'created_time': 1774855952.553727, 'last_price_update_time': 1774855952.553739, 'auction_closing_time': 1774969636.0}
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD29935') HTTP/1.1" 204 0
2026-03-30 07:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb08b070-4e49-582b-acb1-e7bb27256805 with identifier: AF38150
2026-03-30 07:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb08b070-4e49-582b-acb1-e7bb27256805 with identifier: AF38150
2026-03-30 07:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb08b070-4e49-582b-acb1-e7bb27256805 with identifier: AF38150 to the API
2026-03-30 07:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:56:34Z',
 'fuel_type': 'petrol',
 'id': 'cb08b070-4e49-582b-acb1-e7bb27256805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF38150',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 127761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-07',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2011}
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF38150%27 HTTP/1.1" 200 None
2026-03-30 07:32:33 [auto1.de] INFO: Saving data for AF38150: {'auction_closing_time': 1774972594.0, 'created_time': 1773137682.256381, 'last_price_update_time': 1774855953.174125}
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF38150') HTTP/1.1" 204 0
2026-03-30 07:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc42d450>
2026-03-30 07:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa6%252Ff1a6fa2310c0cff2f96d12c91b45ad96%252Fpa%252FVD66153_7b2834216158a13c5689d23f9b7cafa8.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7b2834216158a13c5689d23f9b7cafa8.jpg saved to cache
2026-03-30 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b085219-b80f-5968-9b84-eacefe134677
2026-03-30 07:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b085219-b80f-5968-9b84-eacefe134677, skipping ID generation
2026-03-30 07:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b085219-b80f-5968-9b84-eacefe134677 with scrape type 1
2026-03-30 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b085219-b80f-5968-9b84-eacefe134677 sending to next pipeline
2026-03-30 07:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b085219-b80f-5968-9b84-eacefe134677, identifier: VD66153
2026-03-30 07:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:33 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-30 07:32:33 [auto1.de] INFO: Scrape type for HU95530: 2
2026-03-30 07:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d257039-5f22-5b46-addd-b49c26875880 with identifier: HU95530
2026-03-30 07:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d257039-5f22-5b46-addd-b49c26875880 with scrape type 2
2026-03-30 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d257039-5f22-5b46-addd-b49c26875880 with scrape type 2
2026-03-30 07:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d257039-5f22-5b46-addd-b49c26875880, identifier: HU95530
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_d1fc33b2f64d9728dc59776168bd462d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d1fc33b2f64d9728dc59776168bd462d.jpg not downloaded yet
2026-03-30 07:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b085219-b80f-5968-9b84-eacefe134677 with identifier: VD66153
2026-03-30 07:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b085219-b80f-5968-9b84-eacefe134677 with identifier: VD66153
2026-03-30 07:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b085219-b80f-5968-9b84-eacefe134677 with identifier: VD66153 to the API
2026-03-30 07:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7b2834216158a13c5689d23f9b7cafa8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:42Z',
 'fuel_type': 'petrol',
 'id': '8b085219-b80f-5968-9b84-eacefe134677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD66153',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 154366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_9338e06613b0037c81c9df0e11e8553d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7b2834216158a13c5689d23f9b7cafa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_34296f2cbe9d234318af64aaf56a3b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_ab2e766290a8a2b0b43e2ddf0c4733cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_4675c70e58fa5149d4ad744aaab22d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_3151abe59f8b201f8515a5828b57f07f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_b1264981b4ca3c03f601f890bb7740dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_a6f3bd9a7d190189b9f3a5609f0d07b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_c9f85a6798dd30dcc28a740f27edef98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b085219-b80f-5968-9b84-eacefe134677/8b085219-b80f-5968-9b84-eacefe134677_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a6/f1a6fa2310c0cff2f96d12c91b45ad96/pa/VD66153_7384cb1b2618d2ae80ad63c91c569f19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD66153%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [auto1.de] INFO: Saving data for VD66153: {'created_time': 1774855954.293901, 'last_price_update_time': 1774855954.293915, 'auction_closing_time': 1774971282.0}
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD66153') HTTP/1.1" 204 0
2026-03-30 07:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01213c80-2311-5f60-96aa-f7149dc8adc6 with identifier: HG84341
2026-03-30 07:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01213c80-2311-5f60-96aa-f7149dc8adc6 with scrape type 1
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01213c80-2311-5f60-96aa-f7149dc8adc6
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_4ce0d3705026d4a32af43867dc87c104.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_4ce0d3705026d4a32af43867dc87c104.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_abe1a1e9b6b5c69279e4ee83705a13aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_abe1a1e9b6b5c69279e4ee83705a13aa.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_e6ac4f642f0b82afad75b8cfa5689c44.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_e6ac4f642f0b82afad75b8cfa5689c44.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_5b5809cf4c88594f3873e2fc60a26ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_5b5809cf4c88594f3873e2fc60a26ff4.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_1536afedf290f060f3a89d3c1173f0f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_1536afedf290f060f3a89d3c1173f0f2.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_2a546dac6d634f74acde46ac16be2161.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2a546dac6d634f74acde46ac16be2161.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_33657cfd60ecb8fde777e817050d45c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_33657cfd60ecb8fde777e817050d45c8.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_48350f557f02c0525cf9fa8b1abba89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_48350f557f02c0525cf9fa8b1abba89b.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_2563c33347f6f317b025e23eff3013dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2563c33347f6f317b025e23eff3013dc.jpg already downloaded
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F33%252Fcf33cc1b4ac649ee6e9fd4dec2cd7efe%252Fpa%252FHG84341_91a532e1df4ee578c046c67e4388c7e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_91a532e1df4ee578c046c67e4388c7e6.jpg already downloaded
2026-03-30 07:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01213c80-2311-5f60-96aa-f7149dc8adc6, identifier: HG84341
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3e7910>
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_3d63808c6df801f8669d04518749a9ae.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3d63808c6df801f8669d04518749a9ae.jpg saved to cache
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc92f450>
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_544f63896a54fbe782a31cd135d5161f.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_544f63896a54fbe782a31cd135d5161f.jpg saved to cache
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d9851d-2261-5d60-a2c8-cf9b92a58def with identifier: RE43747
2026-03-30 07:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d9851d-2261-5d60-a2c8-cf9b92a58def with scrape type 1
2026-03-30 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17d9851d-2261-5d60-a2c8-cf9b92a58def
2026-03-30 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_741831e368c142537b09ce3ac7407baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_741831e368c142537b09ce3ac7407baf.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_ca6993a633236b2a444af9fe39a0dbff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ca6993a633236b2a444af9fe39a0dbff.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_ad6b4a23664ba9616a8f3806aeb95f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ad6b4a23664ba9616a8f3806aeb95f8b.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_3b10057ae6fc14d7fd4c45385d151a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_3b10057ae6fc14d7fd4c45385d151a03.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_bb868cddfc48a63904aca62f84bcf43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_bb868cddfc48a63904aca62f84bcf43a.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_683718755441610666ab16ed9d5a5876.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_683718755441610666ab16ed9d5a5876.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_e630b1466a257cde420bdc1e679d85d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_e630b1466a257cde420bdc1e679d85d9.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_8dab3c180fc6465a9076b2aa8cb3b182.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_8dab3c180fc6465a9076b2aa8cb3b182.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_309b19ddfc5464ece799855d0413023d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_309b19ddfc5464ece799855d0413023d.jpg already downloaded
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc3%252Ff2c35b9dfe3cf2884b387b79e54c8048%252Fpa%252FRE43747_521aae7139cb2965b01b0751c841a6c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_521aae7139cb2965b01b0751c841a6c9.jpg already downloaded
2026-03-30 07:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17d9851d-2261-5d60-a2c8-cf9b92a58def, identifier: RE43747
2026-03-30 07:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d257039-5f22-5b46-addd-b49c26875880 with identifier: HU95530
2026-03-30 07:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d257039-5f22-5b46-addd-b49c26875880 with identifier: HU95530
2026-03-30 07:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d257039-5f22-5b46-addd-b49c26875880 with identifier: HU95530 to the API
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:42:59Z',
 'fuel_type': 'diesel',
 'id': '5d257039-5f22-5b46-addd-b49c26875880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU95530',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 174157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-30 07:32:35 [auto1.de] INFO: Saving data for HU95530: {'auction_closing_time': 1774971779.0, 'created_time': 1774636906.314255, 'last_price_update_time': 1774855955.608134}
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU95530') HTTP/1.1" 204 0
2026-03-30 07:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01213c80-2311-5f60-96aa-f7149dc8adc6 with identifier: HG84341
2026-03-30 07:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01213c80-2311-5f60-96aa-f7149dc8adc6 with identifier: HG84341
2026-03-30 07:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01213c80-2311-5f60-96aa-f7149dc8adc6 with identifier: HG84341 to the API
2026-03-30 07:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG84341>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:56Z',
 'fuel_type': 'petrol',
 'id': '01213c80-2311-5f60-96aa-f7149dc8adc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG84341',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 156729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_4ce0d3705026d4a32af43867dc87c104.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_abe1a1e9b6b5c69279e4ee83705a13aa.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_e6ac4f642f0b82afad75b8cfa5689c44.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_5b5809cf4c88594f3873e2fc60a26ff4.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_1536afedf290f060f3a89d3c1173f0f2.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2a546dac6d634f74acde46ac16be2161.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_33657cfd60ecb8fde777e817050d45c8.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_48350f557f02c0525cf9fa8b1abba89b.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2563c33347f6f317b025e23eff3013dc.jpg',
                'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_91a532e1df4ee578c046c67e4388c7e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_4ce0d3705026d4a32af43867dc87c104.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_abe1a1e9b6b5c69279e4ee83705a13aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_e6ac4f642f0b82afad75b8cfa5689c44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2749527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_5b5809cf4c88594f3873e2fc60a26ff4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_1536afedf290f060f3a89d3c1173f0f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2a546dac6d634f74acde46ac16be2161.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_33657cfd60ecb8fde777e817050d45c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_48350f557f02c0525cf9fa8b1abba89b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_2563c33347f6f317b025e23eff3013dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01213c80-2311-5f60-96aa-f7149dc8adc6/01213c80-2311-5f60-96aa-f7149dc8adc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/33/cf33cc1b4ac649ee6e9fd4dec2cd7efe/pa/HG84341_91a532e1df4ee578c046c67e4388c7e6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG84341%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Saving data for HG84341: {'created_time': 1774855956.15057, 'last_price_update_time': 1774855956.150584, 'auction_closing_time': 1774970156.0}
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG84341') HTTP/1.1" 204 0
2026-03-30 07:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17d9851d-2261-5d60-a2c8-cf9b92a58def with identifier: RE43747
2026-03-30 07:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17d9851d-2261-5d60-a2c8-cf9b92a58def with identifier: RE43747
2026-03-30 07:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17d9851d-2261-5d60-a2c8-cf9b92a58def with identifier: RE43747 to the API
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE43747>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:50:00Z',
 'fuel_type': 'diesel',
 'id': '17d9851d-2261-5d60-a2c8-cf9b92a58def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE43747',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 28252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 26,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_741831e368c142537b09ce3ac7407baf.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ca6993a633236b2a444af9fe39a0dbff.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ad6b4a23664ba9616a8f3806aeb95f8b.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_3b10057ae6fc14d7fd4c45385d151a03.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_bb868cddfc48a63904aca62f84bcf43a.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_683718755441610666ab16ed9d5a5876.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_e630b1466a257cde420bdc1e679d85d9.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_8dab3c180fc6465a9076b2aa8cb3b182.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_309b19ddfc5464ece799855d0413023d.jpg',
                'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_521aae7139cb2965b01b0751c841a6c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_741831e368c142537b09ce3ac7407baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ca6993a633236b2a444af9fe39a0dbff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_ad6b4a23664ba9616a8f3806aeb95f8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_3b10057ae6fc14d7fd4c45385d151a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_bb868cddfc48a63904aca62f84bcf43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_683718755441610666ab16ed9d5a5876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_e630b1466a257cde420bdc1e679d85d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_8dab3c180fc6465a9076b2aa8cb3b182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_309b19ddfc5464ece799855d0413023d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d9851d-2261-5d60-a2c8-cf9b92a58def/17d9851d-2261-5d60-a2c8-cf9b92a58def_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c3/f2c35b9dfe3cf2884b387b79e54c8048/pa/RE43747_521aae7139cb2965b01b0751c841a6c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2022}
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE43747%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Saving data for RE43747: {'created_time': 1774855956.53771, 'last_price_update_time': 1774855956.537723, 'auction_closing_time': 1774972200.0}
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE43747') HTTP/1.1" 204 0
2026-03-30 07:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_26c0a7c901cdc22e343cbd675141d46e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: DR13547
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR13547%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Scrape type for DR13547: 1
2026-03-30 07:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc86c450>
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_5cfad68917d6bc93cd01743946a58ea1.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_5cfad68917d6bc93cd01743946a58ea1.jpg saved to cache
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: EW76258
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76258%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Scrape type for EW76258: 1
2026-03-30 07:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc862ed0>
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg saved to cache
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:36 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 7299 | hits on page: 40
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc429b50>
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg saved to cache
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: AV87266
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: PV47102
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: AU31378
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: GZ16727
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ16727%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Scrape type for GZ16727: 2
2026-03-30 07:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a554cd-757a-587f-b547-fcd228527400 with identifier: GZ16727
2026-03-30 07:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a554cd-757a-587f-b547-fcd228527400 with scrape type 2
2026-03-30 07:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a554cd-757a-587f-b547-fcd228527400 with scrape type 2
2026-03-30 07:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8a554cd-757a-587f-b547-fcd228527400, identifier: GZ16727
2026-03-30 07:32:36 [auto1.de] INFO: Found listing with ID: RW74261
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW74261%27 HTTP/1.1" 200 None
2026-03-30 07:32:36 [auto1.de] INFO: Scrape type for RW74261: 1
2026-03-30 07:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d1fc33b2f64d9728dc59776168bd462d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8a554cd-757a-587f-b547-fcd228527400 with identifier: GZ16727
2026-03-30 07:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8a554cd-757a-587f-b547-fcd228527400 with identifier: GZ16727
2026-03-30 07:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8a554cd-757a-587f-b547-fcd228527400 with identifier: GZ16727 to the API
2026-03-30 07:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:11:28Z',
 'fuel_type': 'diesel',
 'id': 'b8a554cd-757a-587f-b547-fcd228527400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ16727',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pathfinder',
 'odometer': 161899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-10',
 'seller_name': None,
 'title': 'Nissan Pathfinder 2.5 dCi SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2006}
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ16727%27 HTTP/1.1" 200 None
2026-03-30 07:32:37 [auto1.de] INFO: Saving data for GZ16727: {'auction_closing_time': 1774969888.0, 'created_time': 1774291833.651046, 'last_price_update_time': 1774855957.221426}
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ16727') HTTP/1.1" 204 0
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc56ca10>
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_26c0a7c901cdc22e343cbd675141d46e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_26c0a7c901cdc22e343cbd675141d46e.jpg saved to cache
2026-03-30 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc9908d0>
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg saved to cache
2026-03-30 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:37 [auto1.de] INFO: Found listing with ID: RW74261
2026-03-30 07:32:37 [auto1.de] INFO: Found listing with ID: UW81873
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW81873%27 HTTP/1.1" 200 None
2026-03-30 07:32:37 [auto1.de] INFO: Scrape type for UW81873: 2
2026-03-30 07:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53b356-a757-5860-bd2f-8a1760e5e4fb with identifier: UW81873
2026-03-30 07:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53b356-a757-5860-bd2f-8a1760e5e4fb with scrape type 2
2026-03-30 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e53b356-a757-5860-bd2f-8a1760e5e4fb with scrape type 2
2026-03-30 07:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e53b356-a757-5860-bd2f-8a1760e5e4fb, identifier: UW81873
2026-03-30 07:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_312a267b2465ac2f80d9fbae0485c049.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e53b356-a757-5860-bd2f-8a1760e5e4fb with identifier: UW81873
2026-03-30 07:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e53b356-a757-5860-bd2f-8a1760e5e4fb with identifier: UW81873
2026-03-30 07:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e53b356-a757-5860-bd2f-8a1760e5e4fb with identifier: UW81873 to the API
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:05:10Z',
 'fuel_type': 'petrol',
 'id': '2e53b356-a757-5860-bd2f-8a1760e5e4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW81873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 92737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW81873%27 HTTP/1.1" 200 None
2026-03-30 07:32:37 [auto1.de] INFO: Saving data for UW81873: {'auction_closing_time': 1774969510.0, 'created_time': 1774292558.990744, 'last_price_update_time': 1774855957.947242}
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW81873') HTTP/1.1" 204 0
2026-03-30 07:32:37 [auto1.de] INFO: Found listing with ID: UW81873
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW81873%27 HTTP/1.1" 200 None
2026-03-30 07:32:37 [auto1.de] INFO: Scrape type for UW81873: 0
2026-03-30 07:32:37 [auto1.de] INFO: Found listing with ID: US20964
2026-03-30 07:32:37 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-30 07:32:38 [auto1.de] INFO: Scrape type for YG60561: 2
2026-03-30 07:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561
2026-03-30 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08150df-6cae-5d4c-bba7-eb997b5c0199 with scrape type 2
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08150df-6cae-5d4c-bba7-eb997b5c0199 with scrape type 2
2026-03-30 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08150df-6cae-5d4c-bba7-eb997b5c0199, identifier: YG60561
2026-03-30 07:32:38 [auto1.de] INFO: Found listing with ID: US20964
2026-03-30 07:32:38 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-30 07:32:38 [auto1.de] INFO: Scrape type for YG60561: 2
2026-03-30 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08150df-6cae-5d4c-bba7-eb997b5c0199 with scrape type 2
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08150df-6cae-5d4c-bba7-eb997b5c0199 with scrape type 2
2026-03-30 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08150df-6cae-5d4c-bba7-eb997b5c0199, identifier: YG60561
2026-03-30 07:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME76972> (referer: https://www.auto1.com/v1/car-details-view/ME76972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 07:32:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-30 07:32:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-30 07:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 07:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca96310>
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F1e%252F9c1e9ed5462fa21aedf410f881908530%252Fpa%252FZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg saved to cache
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d993d6e-f100-59cb-9d3b-857947166a04
2026-03-30 07:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d993d6e-f100-59cb-9d3b-857947166a04, skipping ID generation
2026-03-30 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d993d6e-f100-59cb-9d3b-857947166a04 with scrape type 1
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d993d6e-f100-59cb-9d3b-857947166a04 sending to next pipeline
2026-03-30 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d993d6e-f100-59cb-9d3b-857947166a04, identifier: ZB29861
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc9428d0>
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_d1fc33b2f64d9728dc59776168bd462d.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d1fc33b2f64d9728dc59776168bd462d.jpg saved to cache
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bebd9f50>
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F00%252Fcd0028dd058ef6a263146fa446fe6b3f%252Fpa%252FTF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg saved to cache
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4
2026-03-30 07:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4, skipping ID generation
2026-03-30 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with scrape type 1
2026-03-30 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 sending to next pipeline
2026-03-30 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4, identifier: TF97551
2026-03-30 07:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561
2026-03-30 07:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561
2026-03-30 07:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561 to the API
2026-03-30 07:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:50:45Z',
 'fuel_type': 'diesel',
 'id': 'f08150df-6cae-5d4c-bba7-eb997b5c0199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG60561',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 136409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-30 07:32:39 [auto1.de] INFO: Saving data for YG60561: {'auction_closing_time': 1774972245.0, 'created_time': 1773226841.957125, 'last_price_update_time': 1774855959.289334}
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG60561') HTTP/1.1" 204 0
2026-03-30 07:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561
2026-03-30 07:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561
2026-03-30 07:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08150df-6cae-5d4c-bba7-eb997b5c0199 with identifier: YG60561 to the API
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:50:45Z',
 'fuel_type': 'diesel',
 'id': 'f08150df-6cae-5d4c-bba7-eb997b5c0199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG60561',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 136409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-30 07:32:39 [auto1.de] INFO: Saving data for YG60561: {'auction_closing_time': 1774972245.0, 'created_time': 1773226841.957125, 'last_price_update_time': 1774855959.657969}
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG60561') HTTP/1.1" 204 0
2026-03-30 07:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC88628> (referer: https://www.auto1.com/v1/car-details-view/PC88628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB78581> (referer: https://www.auto1.com/v1/car-details-view/MB78581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d993d6e-f100-59cb-9d3b-857947166a04 with identifier: ZB29861
2026-03-30 07:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d993d6e-f100-59cb-9d3b-857947166a04 with identifier: ZB29861
2026-03-30 07:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d993d6e-f100-59cb-9d3b-857947166a04 with identifier: ZB29861 to the API
2026-03-30 07:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:07:45Z',
 'fuel_type': 'petrol',
 'id': '1d993d6e-f100-59cb-9d3b-857947166a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB29861',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 197182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1361127,
             'Height': 905,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_3d324ed5495d3bef923b16bccbfaf4d8.jpg',
             'Width': 1206},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_ee625223bc49c2713c551f2683ad5dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_12ea2df842a158112117dfb651e9008f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_951b4c929d1252d52c5778a612e7f82b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_433b8c49f0c87f3ff327b2688016bace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_0e76c0aeaf8a30df420c87118779d828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_a88e542af1b93ce53680201aaf74cf35.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_85fa691666fd8db9dd495ba5fea01c3f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_fb50bdcca9e7e9f5e1a130ebeac87dc1.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d993d6e-f100-59cb-9d3b-857947166a04/1d993d6e-f100-59cb-9d3b-857947166a04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/1e/9c1e9ed5462fa21aedf410f881908530/pa/ZB29861_91be5cdacf81e513569790d33f883592.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB29861%27 HTTP/1.1" 200 None
2026-03-30 07:32:40 [auto1.de] INFO: Saving data for ZB29861: {'created_time': 1774855960.548783, 'last_price_update_time': 1774855960.548796, 'auction_closing_time': 1774969665.0}
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB29861') HTTP/1.1" 204 0
2026-03-30 07:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with identifier: TF97551
2026-03-30 07:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with identifier: TF97551
2026-03-30 07:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4 with identifier: TF97551 to the API
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:23:16Z',
 'fuel_type': 'diesel',
 'id': '32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF97551',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 208546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_ea41d0f28b48742c5a0f7388251b7501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3d63808c6df801f8669d04518749a9ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_544f63896a54fbe782a31cd135d5161f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_5cfad68917d6bc93cd01743946a58ea1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_bfc146eae4eab93508b9d10d2f4e5c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_a8a9b5a3f8dddfe557c39748258a2a2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_26c0a7c901cdc22e343cbd675141d46e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d2584cfeb29b80e6d109a3f1dbfca7de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_3fe14d7b51f15d6914dff7ef2f67dc04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4/32b84eb5-6ceb-5ee4-b8fc-1d7db18fc6f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/00/cd0028dd058ef6a263146fa446fe6b3f/pa/TF97551_d1fc33b2f64d9728dc59776168bd462d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF97551%27 HTTP/1.1" 200 None
2026-03-30 07:32:40 [auto1.de] INFO: Saving data for TF97551: {'created_time': 1774855960.999688, 'last_price_update_time': 1774855960.999699, 'auction_closing_time': 1774970596.0}
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF97551') HTTP/1.1" 204 0
2026-03-30 07:32:41 [auto1.de] INFO: Found listing with ID: MU83144
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83144%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [auto1.de] INFO: Scrape type for MU83144: 1
2026-03-30 07:32:41 [auto1.de] INFO: Found listing with ID: MU83144
2026-03-30 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY49050> (referer: https://www.auto1.com/v1/car-details-view/FY49050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc902dd0>
2026-03-30 07:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_312a267b2465ac2f80d9fbae0485c049.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_312a267b2465ac2f80d9fbae0485c049.jpg saved to cache
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB45196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT12498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:41 [auto1.de] INFO: Found listing with ID: DN83607
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN83607%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [auto1.de] INFO: Scrape type for DN83607: 1
2026-03-30 07:32:41 [auto1.de] INFO: Found listing with ID: DN83607
2026-03-30 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with identifier: ME76972
2026-03-30 07:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with scrape type 1
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg not downloaded yet
2026-03-30 07:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ffad207-bf7a-5efa-b918-04526e198a5b with identifier: PC88628
2026-03-30 07:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ffad207-bf7a-5efa-b918-04526e198a5b with scrape type 1
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5ffad207-bf7a-5efa-b918-04526e198a5b
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F4a%252F854a6234ac84204e2b90edf612270006%252Fpa%252FPC88628_66c5ebd710f0d2666440c4435d2d4dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_66c5ebd710f0d2666440c4435d2d4dff.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F4a%252F854a6234ac84204e2b90edf612270006%252Fpa%252FPC88628_e1a527ab28f63245837ea049e7beca34.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_e1a527ab28f63245837ea049e7beca34.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F4a%252F854a6234ac84204e2b90edf612270006%252Fpa%252FPC88628_30c4de6cc0666f756d25fed29120f0e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_30c4de6cc0666f756d25fed29120f0e4.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F4a%252F854a6234ac84204e2b90edf612270006%252Fpa%252FPC88628_7335e4df6f2a5c4d54d263f012990972.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_7335e4df6f2a5c4d54d263f012990972.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F4a%252F854a6234ac84204e2b90edf612270006%252Fpa%252FPC88628_d3f975846131db716a756f452f21df9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_d3f975846131db716a756f452f21df9a.jpg already downloaded
2026-03-30 07:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ffad207-bf7a-5efa-b918-04526e198a5b, identifier: PC88628
2026-03-30 07:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876cc335-57ef-50ae-af75-e1215c89487b with identifier: MB78581
2026-03-30 07:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876cc335-57ef-50ae-af75-e1215c89487b with scrape type 1
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 876cc335-57ef-50ae-af75-e1215c89487b
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_37e644660a4e430ea7ad53d4e83efab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_37e644660a4e430ea7ad53d4e83efab5.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_0a4c6737abb750c1352b54d494e3f76d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0a4c6737abb750c1352b54d494e3f76d.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_0ba06fd324d9ca0b3ed0dd5b05a500f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0ba06fd324d9ca0b3ed0dd5b05a500f9.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_9c7a4602aeb8b7a8476b08607e96b2d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_9c7a4602aeb8b7a8476b08607e96b2d9.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_11a38ebb469243f2786cd51c10afc5ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_11a38ebb469243f2786cd51c10afc5ac.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_bed0858679fcd0a45d362264a2d6d41c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_bed0858679fcd0a45d362264a2d6d41c.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_250de715c9712bb97a67f700348f4380.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_250de715c9712bb97a67f700348f4380.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_0952825fc413bf73193895059e965b95.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0952825fc413bf73193895059e965b95.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_695072fbaa36d8644668f92ef8452d3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_695072fbaa36d8644668f92ef8452d3b.jpg already downloaded
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Faf%252F19af727cfb10cf4e1ca2d2c82edced0a%252Fpa%252FMB78581_be976f5a26dd5a72418eef766ab4c5fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_be976f5a26dd5a72418eef766ab4c5fe.jpg already downloaded
2026-03-30 07:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 876cc335-57ef-50ae-af75-e1215c89487b, identifier: MB78581
2026-03-30 07:32:41 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH63331%27 HTTP/1.1" 200 None
2026-03-30 07:32:41 [auto1.de] INFO: Scrape type for CH63331: 2
2026-03-30 07:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f59143a-0ef1-5930-bc09-681057788dc0 with identifier: CH63331
2026-03-30 07:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f59143a-0ef1-5930-bc09-681057788dc0 with scrape type 2
2026-03-30 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f59143a-0ef1-5930-bc09-681057788dc0 with scrape type 2
2026-03-30 07:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f59143a-0ef1-5930-bc09-681057788dc0, identifier: CH63331
2026-03-30 07:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ffad207-bf7a-5efa-b918-04526e198a5b with identifier: PC88628
2026-03-30 07:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ffad207-bf7a-5efa-b918-04526e198a5b with identifier: PC88628
2026-03-30 07:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ffad207-bf7a-5efa-b918-04526e198a5b with identifier: PC88628 to the API
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC88628>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:16:31Z',
 'fuel_type': 'petrol',
 'id': '5ffad207-bf7a-5efa-b918-04526e198a5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC88628',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mazda',
 'model': '3',
 'odometer': 142183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_66c5ebd710f0d2666440c4435d2d4dff.jpg',
                'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_e1a527ab28f63245837ea049e7beca34.jpg',
                'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_30c4de6cc0666f756d25fed29120f0e4.jpg',
                'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_7335e4df6f2a5c4d54d263f012990972.jpg',
                'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_d3f975846131db716a756f452f21df9a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffad207-bf7a-5efa-b918-04526e198a5b/5ffad207-bf7a-5efa-b918-04526e198a5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_66c5ebd710f0d2666440c4435d2d4dff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffad207-bf7a-5efa-b918-04526e198a5b/5ffad207-bf7a-5efa-b918-04526e198a5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_e1a527ab28f63245837ea049e7beca34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffad207-bf7a-5efa-b918-04526e198a5b/5ffad207-bf7a-5efa-b918-04526e198a5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_30c4de6cc0666f756d25fed29120f0e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffad207-bf7a-5efa-b918-04526e198a5b/5ffad207-bf7a-5efa-b918-04526e198a5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_7335e4df6f2a5c4d54d263f012990972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffad207-bf7a-5efa-b918-04526e198a5b/5ffad207-bf7a-5efa-b918-04526e198a5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/4a/854a6234ac84204e2b90edf612270006/pa/PC88628_d3f975846131db716a756f452f21df9a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 Active Plus',
 'transmission': 'manual',
 'trim': 'Active Plus',
 'year': 2010}
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC88628%27 HTTP/1.1" 200 None
2026-03-30 07:32:42 [auto1.de] INFO: Saving data for PC88628: {'created_time': 1774855962.863731, 'last_price_update_time': 1774855962.863747, 'auction_closing_time': 1774970191.0}
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC88628') HTTP/1.1" 204 0
2026-03-30 07:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 876cc335-57ef-50ae-af75-e1215c89487b with identifier: MB78581
2026-03-30 07:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 876cc335-57ef-50ae-af75-e1215c89487b with identifier: MB78581
2026-03-30 07:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 876cc335-57ef-50ae-af75-e1215c89487b with identifier: MB78581 to the API
2026-03-30 07:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB78581>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:03:23Z',
 'fuel_type': 'hybrid',
 'id': '876cc335-57ef-50ae-af75-e1215c89487b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB78581',
 'listing': 'auction',
 'location': 'DE, Dessau-Roßlau',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 19,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_37e644660a4e430ea7ad53d4e83efab5.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0a4c6737abb750c1352b54d494e3f76d.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0ba06fd324d9ca0b3ed0dd5b05a500f9.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_9c7a4602aeb8b7a8476b08607e96b2d9.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_11a38ebb469243f2786cd51c10afc5ac.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_bed0858679fcd0a45d362264a2d6d41c.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_250de715c9712bb97a67f700348f4380.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0952825fc413bf73193895059e965b95.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_695072fbaa36d8644668f92ef8452d3b.jpg',
                'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_be976f5a26dd5a72418eef766ab4c5fe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_37e644660a4e430ea7ad53d4e83efab5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0a4c6737abb750c1352b54d494e3f76d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0ba06fd324d9ca0b3ed0dd5b05a500f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_9c7a4602aeb8b7a8476b08607e96b2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_11a38ebb469243f2786cd51c10afc5ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_bed0858679fcd0a45d362264a2d6d41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_250de715c9712bb97a67f700348f4380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_0952825fc413bf73193895059e965b95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_695072fbaa36d8644668f92ef8452d3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_876cc335-57ef-50ae-af75-e1215c89487b/876cc335-57ef-50ae-af75-e1215c89487b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/af/19af727cfb10cf4e1ca2d2c82edced0a/pa/MB78581_be976f5a26dd5a72418eef766ab4c5fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid Nightline Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Nightline Edition 4WD',
 'year': 2025}
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB78581%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [auto1.de] INFO: Saving data for MB78581: {'created_time': 1774855963.30682, 'last_price_update_time': 1774855963.306831, 'auction_closing_time': 1774969403.0}
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB78581') HTTP/1.1" 204 0
2026-03-30 07:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_83069744caa99b952f566cbc4aca2e32.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f59143a-0ef1-5930-bc09-681057788dc0 with identifier: CH63331
2026-03-30 07:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f59143a-0ef1-5930-bc09-681057788dc0 with identifier: CH63331
2026-03-30 07:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f59143a-0ef1-5930-bc09-681057788dc0 with identifier: CH63331 to the API
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:46:04Z',
 'fuel_type': 'petrol',
 'id': '0f59143a-0ef1-5930-bc09-681057788dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH63331',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 75690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-20',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH63331%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [auto1.de] INFO: Saving data for CH63331: {'auction_closing_time': 1774971964.0, 'created_time': 1774348537.808105, 'last_price_update_time': 1774855963.727111}
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH63331') HTTP/1.1" 204 0
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg not downloaded yet
2026-03-30 07:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:43 [auto1.de] INFO: Found listing with ID: AW55090
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW55090%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [auto1.de] INFO: Scrape type for AW55090: 1
2026-03-30 07:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG83409> (referer: https://www.auto1.com/v1/car-details-view/VG83409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db15f470-fd6a-519b-a67a-84a8145b8206 with identifier: FY49050
2026-03-30 07:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db15f470-fd6a-519b-a67a-84a8145b8206 with scrape type 1
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db15f470-fd6a-519b-a67a-84a8145b8206
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_6ffd36342eb12fdc9636ea980231360e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_6ffd36342eb12fdc9636ea980231360e.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_3f63dec62e96cd115fce65d9a25aa1c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3f63dec62e96cd115fce65d9a25aa1c6.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_aefa454066b231abcdbe1cdbddd5f8c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_aefa454066b231abcdbe1cdbddd5f8c4.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_ff9098771ed37fa17f3170280c037485.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_ff9098771ed37fa17f3170280c037485.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_0b03b4b8ea5611bab38d01c02aa6e57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_0b03b4b8ea5611bab38d01c02aa6e57c.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_3fe808e3ebd5a0262f5ad57334ab51af.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3fe808e3ebd5a0262f5ad57334ab51af.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_dab0e736729cb52c3b83982e2e2c68d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_dab0e736729cb52c3b83982e2e2c68d9.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_92e33765d39c37f7bc4d7df64738ea96.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_92e33765d39c37f7bc4d7df64738ea96.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_af0ec3b1c733971f15683bde5d10726f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_af0ec3b1c733971f15683bde5d10726f.jpg already downloaded
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F12%252Fd412309b3d96a64ef8e38c4e9fc37e5c%252Fpa%252FFY49050_512bdaa9fcc5f4289372716f72549c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_512bdaa9fcc5f4289372716f72549c51.jpg already downloaded
2026-03-30 07:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db15f470-fd6a-519b-a67a-84a8145b8206, identifier: FY49050
2026-03-30 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_d9bed550f3a61e42be79e36fce70300d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d9bed550f3a61e42be79e36fce70300d.jpg not downloaded yet
2026-03-30 07:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db15f470-fd6a-519b-a67a-84a8145b8206 with identifier: FY49050
2026-03-30 07:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db15f470-fd6a-519b-a67a-84a8145b8206 with identifier: FY49050
2026-03-30 07:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db15f470-fd6a-519b-a67a-84a8145b8206 with identifier: FY49050 to the API
2026-03-30 07:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FY49050>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:53:17Z',
 'fuel_type': 'diesel',
 'id': 'db15f470-fd6a-519b-a67a-84a8145b8206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY49050',
 'listing': 'auction',
 'location': 'Velen-Ramsdorf',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_6ffd36342eb12fdc9636ea980231360e.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3f63dec62e96cd115fce65d9a25aa1c6.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_aefa454066b231abcdbe1cdbddd5f8c4.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_ff9098771ed37fa17f3170280c037485.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_0b03b4b8ea5611bab38d01c02aa6e57c.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3fe808e3ebd5a0262f5ad57334ab51af.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_dab0e736729cb52c3b83982e2e2c68d9.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_92e33765d39c37f7bc4d7df64738ea96.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_af0ec3b1c733971f15683bde5d10726f.jpg',
                'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_512bdaa9fcc5f4289372716f72549c51.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_6ffd36342eb12fdc9636ea980231360e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3f63dec62e96cd115fce65d9a25aa1c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_aefa454066b231abcdbe1cdbddd5f8c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_ff9098771ed37fa17f3170280c037485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_0b03b4b8ea5611bab38d01c02aa6e57c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_3fe808e3ebd5a0262f5ad57334ab51af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_dab0e736729cb52c3b83982e2e2c68d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_92e33765d39c37f7bc4d7df64738ea96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_af0ec3b1c733971f15683bde5d10726f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db15f470-fd6a-519b-a67a-84a8145b8206/db15f470-fd6a-519b-a67a-84a8145b8206_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/12/d412309b3d96a64ef8e38c4e9fc37e5c/pa/FY49050_512bdaa9fcc5f4289372716f72549c51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2011}
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY49050%27 HTTP/1.1" 200 None
2026-03-30 07:32:45 [auto1.de] INFO: Saving data for FY49050: {'created_time': 1774855965.454751, 'last_price_update_time': 1774855965.454763, 'auction_closing_time': 1774972397.0}
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY49050') HTTP/1.1" 204 0
2026-03-30 07:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_27d5c7006f4281f04644136ca7805daa.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:45 [auto1.de] INFO: Found listing with ID: DF41364
2026-03-30 07:32:45 [auto1.de] INFO: Found listing with ID: KS24021
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS24021%27 HTTP/1.1" 200 None
2026-03-30 07:32:45 [auto1.de] INFO: Scrape type for KS24021: 2
2026-03-30 07:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with identifier: KS24021
2026-03-30 07:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with scrape type 2
2026-03-30 07:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with scrape type 2
2026-03-30 07:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03991de1-b8d5-5636-9c57-5ff9c4df3c55, identifier: KS24021
2026-03-30 07:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc30f510>
2026-03-30 07:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_83069744caa99b952f566cbc4aca2e32.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_83069744caa99b952f566cbc4aca2e32.jpg saved to cache
2026-03-30 07:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with identifier: KS24021
2026-03-30 07:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with identifier: KS24021
2026-03-30 07:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03991de1-b8d5-5636-9c57-5ff9c4df3c55 with identifier: KS24021 to the API
2026-03-30 07:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:28:43Z',
 'fuel_type': 'petrol',
 'id': '03991de1-b8d5-5636-9c57-5ff9c4df3c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS24021',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 36443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS24021%27 HTTP/1.1" 200 None
2026-03-30 07:32:46 [auto1.de] INFO: Saving data for KS24021: {'auction_closing_time': 1774970923.0, 'created_time': 1773685899.80626, 'last_price_update_time': 1774855966.430103}
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS24021') HTTP/1.1" 204 0
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg not downloaded yet
2026-03-30 07:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:46 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-30 07:32:46 [auto1.de] INFO: Found listing with ID: HX93212
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX93212%27 HTTP/1.1" 200 None
2026-03-30 07:32:46 [auto1.de] INFO: Scrape type for HX93212: 1
2026-03-30 07:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR13547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8e9350>
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ff8%252F58f8007fdd177870a163572747f8bf8d%252Fpa%252FXP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg saved to cache
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36e34e37-094e-5bff-82a8-927e5b445eb2
2026-03-30 07:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36e34e37-094e-5bff-82a8-927e5b445eb2, skipping ID generation
2026-03-30 07:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e34e37-094e-5bff-82a8-927e5b445eb2 with scrape type 1
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36e34e37-094e-5bff-82a8-927e5b445eb2 sending to next pipeline
2026-03-30 07:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36e34e37-094e-5bff-82a8-927e5b445eb2, identifier: XP13096
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6bbcd0>
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg saved to cache
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf06035-5673-5d24-ab1e-cebafc5ae28a with identifier: VG83409
2026-03-30 07:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf06035-5673-5d24-ab1e-cebafc5ae28a with scrape type 1
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg not downloaded yet
2026-03-30 07:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_197790e78c95084fd7e6c4d74e59eae7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_160c5d1e329e04f75f9732e36ee69e72.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_160c5d1e329e04f75f9732e36ee69e72.jpg not downloaded yet
2026-03-30 07:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36e34e37-094e-5bff-82a8-927e5b445eb2 with identifier: XP13096
2026-03-30 07:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36e34e37-094e-5bff-82a8-927e5b445eb2 with identifier: XP13096
2026-03-30 07:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36e34e37-094e-5bff-82a8-927e5b445eb2 with identifier: XP13096 to the API
2026-03-30 07:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:05:47Z',
 'fuel_type': 'petrol',
 'id': '36e34e37-094e-5bff-82a8-927e5b445eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP13096',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 104794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a8c0454ab6526ae847d2776a3bedf33d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_4d0afc674f90eb4034ed6d8f993f7cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_d8a50a65fb217b931fa070f2c2e11de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_a02344de450ee917fbf7a0978d06093d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_95c40603e859aca255f92a42a545dfa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e37-094e-5bff-82a8-927e5b445eb2/36e34e37-094e-5bff-82a8-927e5b445eb2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/f8/58f8007fdd177870a163572747f8bf8d/pa/XP13096_8894d96ab38ee2f9ebbb90077336ab10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C2 1.4 VTR Plus',
 'transmission': 'manual',
 'trim': 'VTR Plus',
 'year': 2008}
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP13096%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [auto1.de] INFO: Saving data for XP13096: {'created_time': 1774855968.575527, 'last_price_update_time': 1774855968.575538, 'auction_closing_time': 1774969547.0}
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP13096') HTTP/1.1" 204 0
2026-03-30 07:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:48 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-30 07:32:48 [auto1.de] INFO: Found listing with ID: DW80278
2026-03-30 07:32:48 [auto1.de] INFO: Found listing with ID: FH27884
2026-03-30 07:32:48 [auto1.de] INFO: Found listing with ID: YE99980
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE99980%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [auto1.de] INFO: Scrape type for YE99980: 1
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg not downloaded yet
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc964d50>
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_27d5c7006f4281f04644136ca7805daa.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_27d5c7006f4281f04644136ca7805daa.jpg saved to cache
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_5bf85c698770bcf6a4374df8c6937665.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_5bf85c698770bcf6a4374df8c6937665.jpg not downloaded yet
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc30f750>
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg saved to cache
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:48 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 7320 | hits on page: 40
2026-03-30 07:32:48 [auto1.de] INFO: Found listing with ID: NE04560
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE04560%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [auto1.de] INFO: Scrape type for NE04560: 2
2026-03-30 07:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7936940-d120-5b1b-9455-156bb0a4fb3d with identifier: NE04560
2026-03-30 07:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7936940-d120-5b1b-9455-156bb0a4fb3d with scrape type 2
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7936940-d120-5b1b-9455-156bb0a4fb3d with scrape type 2
2026-03-30 07:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7936940-d120-5b1b-9455-156bb0a4fb3d, identifier: NE04560
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_523b4a80a461e98cae8b0480d2cbace0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_523b4a80a461e98cae8b0480d2cbace0.jpg not downloaded yet
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT75427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW76258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU83144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW74261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT95887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d9bed550f3a61e42be79e36fce70300d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7936940-d120-5b1b-9455-156bb0a4fb3d with identifier: NE04560
2026-03-30 07:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7936940-d120-5b1b-9455-156bb0a4fb3d with identifier: NE04560
2026-03-30 07:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7936940-d120-5b1b-9455-156bb0a4fb3d with identifier: NE04560 to the API
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:52:54Z',
 'fuel_type': 'petrol',
 'id': 'f7936940-d120-5b1b-9455-156bb0a4fb3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE04560',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 80567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2014}
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE04560%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [auto1.de] INFO: Saving data for NE04560: {'auction_closing_time': 1774972374.0, 'created_time': 1773658477.979112, 'last_price_update_time': 1774855969.557912}
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE04560') HTTP/1.1" 204 0
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg not downloaded yet
2026-03-30 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: SY47476
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47476%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [auto1.de] INFO: Scrape type for SY47476: 1
2026-03-30 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4301d0>
2026-03-30 07:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_197790e78c95084fd7e6c4d74e59eae7.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_197790e78c95084fd7e6c4d74e59eae7.jpg saved to cache
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: JT04540
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: SY47476
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_915acfcca34f94c35a372dd52933b959.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_915acfcca34f94c35a372dd52933b959.jpg not downloaded yet
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_2ff030d313412bc545d7935378ba6c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2ff030d313412bc545d7935378ba6c2b.jpg not downloaded yet
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [auto1.de] INFO: Scrape type for HN83229: 2
2026-03-30 07:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229
2026-03-30 07:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76ab7bd-806a-5407-8bb8-1c2b169293b5 with scrape type 2
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76ab7bd-806a-5407-8bb8-1c2b169293b5 with scrape type 2
2026-03-30 07:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76ab7bd-806a-5407-8bb8-1c2b169293b5, identifier: HN83229
2026-03-30 07:32:49 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [auto1.de] INFO: Scrape type for HN83229: 2
2026-03-30 07:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76ab7bd-806a-5407-8bb8-1c2b169293b5 with scrape type 2
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76ab7bd-806a-5407-8bb8-1c2b169293b5 with scrape type 2
2026-03-30 07:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76ab7bd-806a-5407-8bb8-1c2b169293b5, identifier: HN83229
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg not downloaded yet
2026-03-30 07:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229
2026-03-30 07:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229
2026-03-30 07:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229 to the API
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:27:52Z',
 'fuel_type': 'diesel',
 'id': 'a76ab7bd-806a-5407-8bb8-1c2b169293b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN83229',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 120971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-30 07:32:50 [auto1.de] INFO: Saving data for HN83229: {'auction_closing_time': 1774970872.0, 'created_time': 1774637037.356332, 'last_price_update_time': 1774855970.458312}
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN83229') HTTP/1.1" 204 0
2026-03-30 07:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN83607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be874e50>
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg saved to cache
2026-03-30 07:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc319710>
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_d9bed550f3a61e42be79e36fce70300d.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d9bed550f3a61e42be79e36fce70300d.jpg saved to cache
2026-03-30 07:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229
2026-03-30 07:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229
2026-03-30 07:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76ab7bd-806a-5407-8bb8-1c2b169293b5 with identifier: HN83229 to the API
2026-03-30 07:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:27:52Z',
 'fuel_type': 'diesel',
 'id': 'a76ab7bd-806a-5407-8bb8-1c2b169293b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN83229',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 120971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-30 07:32:51 [auto1.de] INFO: Saving data for HN83229: {'auction_closing_time': 1774970872.0, 'created_time': 1774637037.356332, 'last_price_update_time': 1774855971.454468}
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN83229') HTTP/1.1" 204 0
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_2c0ccba4c506c8bea5c8291705371248.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2c0ccba4c506c8bea5c8291705371248.jpg not downloaded yet
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS21174%27 HTTP/1.1" 200 None
2026-03-30 07:32:51 [auto1.de] INFO: Scrape type for PS21174: 2
2026-03-30 07:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174
2026-03-30 07:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with scrape type 2
2026-03-30 07:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with scrape type 2
2026-03-30 07:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d, identifier: PS21174
2026-03-30 07:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_5bf85c698770bcf6a4374df8c6937665.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_160c5d1e329e04f75f9732e36ee69e72.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 07:32:51 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS21174%27 HTTP/1.1" 200 None
2026-03-30 07:32:51 [auto1.de] INFO: Scrape type for PS21174: 2
2026-03-30 07:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with scrape type 2
2026-03-30 07:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with scrape type 2
2026-03-30 07:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d, identifier: PS21174
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg not downloaded yet
2026-03-30 07:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174
2026-03-30 07:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174
2026-03-30 07:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174 to the API
2026-03-30 07:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:43:45Z',
 'fuel_type': 'petrol',
 'id': '8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS21174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TTS',
 'odometer': 125763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'Audi TTS 2.0 TFSI quattro Coupe',
 'transmission': 'manual',
 'trim': 'quattro Coupe',
 'year': 2008}
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS21174%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [auto1.de] INFO: Saving data for PS21174: {'auction_closing_time': 1774971825.0, 'created_time': 1773687708.285073, 'last_price_update_time': 1774855972.193026}
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS21174') HTTP/1.1" 204 0
2026-03-30 07:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174
2026-03-30 07:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174
2026-03-30 07:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d with identifier: PS21174 to the API
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:43:45Z',
 'fuel_type': 'petrol',
 'id': '8817b5a9-e5b6-588f-8cc9-86d6d1b58d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS21174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TTS',
 'odometer': 125763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'Audi TTS 2.0 TFSI quattro Coupe',
 'transmission': 'manual',
 'trim': 'quattro Coupe',
 'year': 2008}
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS21174%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [auto1.de] INFO: Saving data for PS21174: {'auction_closing_time': 1774971825.0, 'created_time': 1773687708.285073, 'last_price_update_time': 1774855972.522782}
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS21174') HTTP/1.1" 204 0
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_fc9ab316dc71f25f587801f4353365d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_fc9ab316dc71f25f587801f4353365d6.jpg not downloaded yet
2026-03-30 07:32:52 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ43291%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [auto1.de] INFO: Scrape type for YJ43291: 2
2026-03-30 07:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-03-30 07:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 2
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 2
2026-03-30 07:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23116f69-c0ba-586f-93e6-e50eb7ad0720, identifier: YJ43291
2026-03-30 07:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca4bf90>
2026-03-30 07:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg saved to cache
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:52 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ43291%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [auto1.de] INFO: Scrape type for YJ43291: 2
2026-03-30 07:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 2
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23116f69-c0ba-586f-93e6-e50eb7ad0720 with scrape type 2
2026-03-30 07:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23116f69-c0ba-586f-93e6-e50eb7ad0720, identifier: YJ43291
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_9a241ad47222949783edcc389dca5080.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_9a241ad47222949783edcc389dca5080.jpg not downloaded yet
2026-03-30 07:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-03-30 07:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-03-30 07:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291 to the API
2026-03-30 07:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:56:38Z',
 'fuel_type': 'petrol',
 'id': '23116f69-c0ba-586f-93e6-e50eb7ad0720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ43291',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 78207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ43291%27 HTTP/1.1" 200 None
2026-03-30 07:32:53 [auto1.de] INFO: Saving data for YJ43291: {'auction_closing_time': 1774972598.0, 'created_time': 1774294676.853738, 'last_price_update_time': 1774855973.413519}
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ43291') HTTP/1.1" 204 0
2026-03-30 07:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_826628e5ab932a1b34c63160ca301a3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-03-30 07:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291
2026-03-30 07:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23116f69-c0ba-586f-93e6-e50eb7ad0720 with identifier: YJ43291 to the API
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:56:38Z',
 'fuel_type': 'petrol',
 'id': '23116f69-c0ba-586f-93e6-e50eb7ad0720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ43291',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 78207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ43291%27 HTTP/1.1" 200 None
2026-03-30 07:32:53 [auto1.de] INFO: Saving data for YJ43291: {'auction_closing_time': 1774972598.0, 'created_time': 1774294676.853738, 'last_price_update_time': 1774855973.744283}
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ43291') HTTP/1.1" 204 0
2026-03-30 07:32:53 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM49725%27 HTTP/1.1" 200 None
2026-03-30 07:32:53 [auto1.de] INFO: Scrape type for MM49725: 2
2026-03-30 07:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725
2026-03-30 07:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45532f95-9f37-5c52-bae9-2267e3e39e84 with scrape type 2
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45532f95-9f37-5c52-bae9-2267e3e39e84 with scrape type 2
2026-03-30 07:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45532f95-9f37-5c52-bae9-2267e3e39e84, identifier: MM49725
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7496d0>
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_5bf85c698770bcf6a4374df8c6937665.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_5bf85c698770bcf6a4374df8c6937665.jpg saved to cache
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc576050>
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_160c5d1e329e04f75f9732e36ee69e72.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_160c5d1e329e04f75f9732e36ee69e72.jpg saved to cache
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:53 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM49725%27 HTTP/1.1" 200 None
2026-03-30 07:32:53 [auto1.de] INFO: Scrape type for MM49725: 2
2026-03-30 07:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45532f95-9f37-5c52-bae9-2267e3e39e84 with scrape type 2
2026-03-30 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45532f95-9f37-5c52-bae9-2267e3e39e84 with scrape type 2
2026-03-30 07:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45532f95-9f37-5c52-bae9-2267e3e39e84, identifier: MM49725
2026-03-30 07:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg not downloaded yet
2026-03-30 07:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725
2026-03-30 07:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725
2026-03-30 07:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725 to the API
2026-03-30 07:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:04:16Z',
 'fuel_type': 'diesel',
 'id': '45532f95-9f37-5c52-bae9-2267e3e39e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM49725',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-13',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM49725%27 HTTP/1.1" 200 None
2026-03-30 07:32:55 [auto1.de] INFO: Saving data for MM49725: {'auction_closing_time': 1774969456.0, 'created_time': 1773688909.390446, 'last_price_update_time': 1774855975.802906}
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM49725') HTTP/1.1" 204 0
2026-03-30 07:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2ff030d313412bc545d7935378ba6c2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725
2026-03-30 07:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725
2026-03-30 07:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45532f95-9f37-5c52-bae9-2267e3e39e84 with identifier: MM49725 to the API
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:04:16Z',
 'fuel_type': 'diesel',
 'id': '45532f95-9f37-5c52-bae9-2267e3e39e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM49725',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-13',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM49725%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [auto1.de] INFO: Saving data for MM49725: {'auction_closing_time': 1774969456.0, 'created_time': 1773688909.390446, 'last_price_update_time': 1774855976.107341}
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM49725') HTTP/1.1" 204 0
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17171%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [auto1.de] INFO: Scrape type for AL17171: 1
2026-03-30 07:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2c0ccba4c506c8bea5c8291705371248.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg not downloaded yet
2026-03-30 07:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8207d0>
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg saved to cache
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc823290>
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_826628e5ab932a1b34c63160ca301a3e.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_826628e5ab932a1b34c63160ca301a3e.jpg saved to cache
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF02857%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [auto1.de] INFO: Scrape type for RF02857: 2
2026-03-30 07:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857
2026-03-30 07:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with scrape type 2
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with scrape type 2
2026-03-30 07:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2, identifier: RF02857
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 07:32:56 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF02857%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [auto1.de] INFO: Scrape type for RF02857: 2
2026-03-30 07:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with scrape type 2
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with scrape type 2
2026-03-30 07:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2, identifier: RF02857
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg not downloaded yet
2026-03-30 07:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857
2026-03-30 07:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857
2026-03-30 07:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857 to the API
2026-03-30 07:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:49:14Z',
 'fuel_type': 'diesel',
 'id': 'e3974ac5-7f03-5e9c-a643-8ae6fc0096e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF02857',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 189026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
 'transmission': 'automatic',
 'trim': 'Trendline 4Motion',
 'year': 2012}
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF02857%27 HTTP/1.1" 200 None
2026-03-30 07:32:57 [auto1.de] INFO: Saving data for RF02857: {'auction_closing_time': 1774972154.0, 'created_time': 1773303664.46108, 'last_price_update_time': 1774855977.295551}
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF02857') HTTP/1.1" 204 0
2026-03-30 07:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6fd790>
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F74%252F9a74ed9c4e6ecdbcdbc77d2760491c1b%252Fpa%252FCL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg saved to cache
2026-03-30 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541
2026-03-30 07:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541, skipping ID generation
2026-03-30 07:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with scrape type 1
2026-03-30 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 sending to next pipeline
2026-03-30 07:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541, identifier: CL81037
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc758510>
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_2ff030d313412bc545d7935378ba6c2b.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2ff030d313412bc545d7935378ba6c2b.jpg saved to cache
2026-03-30 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857
2026-03-30 07:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857
2026-03-30 07:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3974ac5-7f03-5e9c-a643-8ae6fc0096e2 with identifier: RF02857 to the API
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:49:14Z',
 'fuel_type': 'diesel',
 'id': 'e3974ac5-7f03-5e9c-a643-8ae6fc0096e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF02857',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 189026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
 'transmission': 'automatic',
 'trim': 'Trendline 4Motion',
 'year': 2012}
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF02857%27 HTTP/1.1" 200 None
2026-03-30 07:32:57 [auto1.de] INFO: Saving data for RF02857: {'auction_closing_time': 1774972154.0, 'created_time': 1773303664.46108, 'last_price_update_time': 1774855977.991323}
2026-03-30 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF02857') HTTP/1.1" 204 0
2026-03-30 07:32:58 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 07:32:58 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71499%27 HTTP/1.1" 200 None
2026-03-30 07:32:58 [auto1.de] INFO: Scrape type for GF71499: 2
2026-03-30 07:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499
2026-03-30 07:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26495c5-3216-52ad-b596-0127ee30c0cf with scrape type 2
2026-03-30 07:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26495c5-3216-52ad-b596-0127ee30c0cf with scrape type 2
2026-03-30 07:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a26495c5-3216-52ad-b596-0127ee30c0cf, identifier: GF71499
2026-03-30 07:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with identifier: CL81037
2026-03-30 07:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with identifier: CL81037
2026-03-30 07:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7155ef43-ce9b-5c97-9c2a-a61d3d23b541 with identifier: CL81037 to the API
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:32:06Z',
 'fuel_type': 'hybrid',
 'id': '7155ef43-ce9b-5c97-9c2a-a61d3d23b541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL81037',
 'listing': 'auction',
 'location': 'DE, Ludwigshafen am Rhein',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 201124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0f6dfd1a5d10453785ee7eb92919b52b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_5669c8a9c3dda4c8b0700590447e1b52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3966849e2d9b2a973a4eb5a5b7d9e035.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3e530bc68c434de7f41da33482285112.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_993fb27c9a4b23877b477d70029bb91f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_bc63506b4d74020d876f498730347eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_0bbb890f1caf2417bee1aec797953054.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_3a5b2b86b16a7ba6444126a53162e0d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764208,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_8921c1cef766ae2cf7f107e5ce99f08e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7155ef43-ce9b-5c97-9c2a-a61d3d23b541/7155ef43-ce9b-5c97-9c2a-a61d3d23b541_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/74/9a74ed9c4e6ecdbcdbc77d2760491c1b/pa/CL81037_1eb62f243aef5e481b454fdddff7f31f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2010}
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL81037%27 HTTP/1.1" 200 None
2026-03-30 07:32:58 [auto1.de] INFO: Saving data for CL81037: {'created_time': 1774855978.557701, 'last_price_update_time': 1774855978.557711, 'auction_closing_time': 1774971126.0}
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL81037') HTTP/1.1" 204 0
2026-03-30 07:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:58 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 07:32:58 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71499%27 HTTP/1.1" 200 None
2026-03-30 07:32:58 [auto1.de] INFO: Scrape type for GF71499: 2
2026-03-30 07:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26495c5-3216-52ad-b596-0127ee30c0cf with scrape type 2
2026-03-30 07:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26495c5-3216-52ad-b596-0127ee30c0cf with scrape type 2
2026-03-30 07:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a26495c5-3216-52ad-b596-0127ee30c0cf, identifier: GF71499
2026-03-30 07:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499
2026-03-30 07:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499
2026-03-30 07:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499 to the API
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:08:52Z',
 'fuel_type': 'petrol',
 'id': 'a26495c5-3216-52ad-b596-0127ee30c0cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF71499',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 84250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71499%27 HTTP/1.1" 200 None
2026-03-30 07:32:59 [auto1.de] INFO: Saving data for GF71499: {'auction_closing_time': 1774969732.0, 'created_time': 1774118890.740489, 'last_price_update_time': 1774855979.036545}
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF71499') HTTP/1.1" 204 0
2026-03-30 07:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR13547> (referer: https://www.auto1.com/v1/car-details-view/DR13547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE99980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc574d90>
2026-03-30 07:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_2c0ccba4c506c8bea5c8291705371248.jpg') HTTP/1.1" 204 0
2026-03-30 07:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2c0ccba4c506c8bea5c8291705371248.jpg saved to cache
2026-03-30 07:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499
2026-03-30 07:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499
2026-03-30 07:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a26495c5-3216-52ad-b596-0127ee30c0cf with identifier: GF71499 to the API
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:08:52Z',
 'fuel_type': 'petrol',
 'id': 'a26495c5-3216-52ad-b596-0127ee30c0cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF71499',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 84250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71499%27 HTTP/1.1" 200 None
2026-03-30 07:32:59 [auto1.de] INFO: Saving data for GF71499: {'auction_closing_time': 1774969732.0, 'created_time': 1774118890.740489, 'last_price_update_time': 1774855979.403447}
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF71499') HTTP/1.1" 204 0
2026-03-30 07:32:59 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN37654%27 HTTP/1.1" 200 None
2026-03-30 07:32:59 [auto1.de] INFO: Scrape type for EN37654: 2
2026-03-30 07:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654
2026-03-30 07:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79ca3079-31d0-5436-b128-8aa463db8894 with scrape type 2
2026-03-30 07:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79ca3079-31d0-5436-b128-8aa463db8894 with scrape type 2
2026-03-30 07:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79ca3079-31d0-5436-b128-8aa463db8894, identifier: EN37654
2026-03-30 07:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT12498> (referer: https://www.auto1.com/v1/car-details-view/NT12498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:32:59 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN37654%27 HTTP/1.1" 200 None
2026-03-30 07:32:59 [auto1.de] INFO: Scrape type for EN37654: 2
2026-03-30 07:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79ca3079-31d0-5436-b128-8aa463db8894 with scrape type 2
2026-03-30 07:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79ca3079-31d0-5436-b128-8aa463db8894 with scrape type 2
2026-03-30 07:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79ca3079-31d0-5436-b128-8aa463db8894, identifier: EN37654
2026-03-30 07:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654
2026-03-30 07:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654
2026-03-30 07:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654 to the API
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:19:46Z',
 'fuel_type': 'petrol',
 'id': '79ca3079-31d0-5436-b128-8aa463db8894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN37654',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 89222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'BMW 4er 428i Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN37654%27 HTTP/1.1" 200 None
2026-03-30 07:33:00 [auto1.de] INFO: Saving data for EN37654: {'auction_closing_time': 1774970386.0, 'created_time': 1774294817.054039, 'last_price_update_time': 1774855980.028933}
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN37654') HTTP/1.1" 204 0
2026-03-30 07:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654
2026-03-30 07:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654
2026-03-30 07:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79ca3079-31d0-5436-b128-8aa463db8894 with identifier: EN37654 to the API
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:19:46Z',
 'fuel_type': 'petrol',
 'id': '79ca3079-31d0-5436-b128-8aa463db8894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN37654',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 89222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'BMW 4er 428i Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN37654%27 HTTP/1.1" 200 None
2026-03-30 07:33:00 [auto1.de] INFO: Saving data for EN37654: {'auction_closing_time': 1774970386.0, 'created_time': 1774294817.054039, 'last_price_update_time': 1774855980.350715}
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN37654') HTTP/1.1" 204 0
2026-03-30 07:33:00 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-30 07:33:00 [auto1.de] INFO: Scrape type for SK33918: 2
2026-03-30 07:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918
2026-03-30 07:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1553849-c2b3-54d8-8c4d-317c7025d84c with scrape type 2
2026-03-30 07:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1553849-c2b3-54d8-8c4d-317c7025d84c with scrape type 2
2026-03-30 07:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1553849-c2b3-54d8-8c4d-317c7025d84c, identifier: SK33918
2026-03-30 07:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT95887> (referer: https://www.auto1.com/v1/car-details-view/GT95887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:00 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 7340 | hits on page: 40
2026-03-30 07:33:00 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-30 07:33:00 [auto1.de] INFO: Scrape type for SK33918: 2
2026-03-30 07:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1553849-c2b3-54d8-8c4d-317c7025d84c with scrape type 2
2026-03-30 07:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1553849-c2b3-54d8-8c4d-317c7025d84c with scrape type 2
2026-03-30 07:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1553849-c2b3-54d8-8c4d-317c7025d84c, identifier: SK33918
2026-03-30 07:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918
2026-03-30 07:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918
2026-03-30 07:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918 to the API
2026-03-30 07:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:20:29Z',
 'fuel_type': 'petrol',
 'id': 'd1553849-c2b3-54d8-8c4d-317c7025d84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK33918',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 110929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-30 07:33:01 [auto1.de] INFO: Saving data for SK33918: {'auction_closing_time': 1774970429.0, 'created_time': 1773132232.575489, 'last_price_update_time': 1774855981.182577}
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK33918') HTTP/1.1" 204 0
2026-03-30 07:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918
2026-03-30 07:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918
2026-03-30 07:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1553849-c2b3-54d8-8c4d-317c7025d84c with identifier: SK33918 to the API
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:20:29Z',
 'fuel_type': 'petrol',
 'id': 'd1553849-c2b3-54d8-8c4d-317c7025d84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK33918',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 110929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-30 07:33:01 [auto1.de] INFO: Saving data for SK33918: {'auction_closing_time': 1774970429.0, 'created_time': 1773132232.575489, 'last_price_update_time': 1774855981.972977}
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK33918') HTTP/1.1" 204 0
2026-03-30 07:33:01 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 07:33:01 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN15380%27 HTTP/1.1" 200 None
2026-03-30 07:33:02 [auto1.de] INFO: Scrape type for BN15380: 2
2026-03-30 07:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380
2026-03-30 07:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05186133-85f3-59e1-b050-e4fdd6daaee3 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05186133-85f3-59e1-b050-e4fdd6daaee3 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05186133-85f3-59e1-b050-e4fdd6daaee3, identifier: BN15380
2026-03-30 07:33:02 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 07:33:02 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM10989%27 HTTP/1.1" 200 None
2026-03-30 07:33:02 [auto1.de] INFO: Scrape type for GM10989: 2
2026-03-30 07:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb772a61-e74c-5966-86de-44e7b36fa8c1 with identifier: GM10989
2026-03-30 07:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb772a61-e74c-5966-86de-44e7b36fa8c1 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb772a61-e74c-5966-86de-44e7b36fa8c1 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb772a61-e74c-5966-86de-44e7b36fa8c1, identifier: GM10989
2026-03-30 07:33:02 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 07:33:02 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN15380%27 HTTP/1.1" 200 None
2026-03-30 07:33:02 [auto1.de] INFO: Scrape type for BN15380: 2
2026-03-30 07:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05186133-85f3-59e1-b050-e4fdd6daaee3 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05186133-85f3-59e1-b050-e4fdd6daaee3 with scrape type 2
2026-03-30 07:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05186133-85f3-59e1-b050-e4fdd6daaee3, identifier: BN15380
2026-03-30 07:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380
2026-03-30 07:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380
2026-03-30 07:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380 to the API
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:51:20Z',
 'fuel_type': 'petrol',
 'id': '05186133-85f3-59e1-b050-e4fdd6daaee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN15380',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 35435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN15380%27 HTTP/1.1" 200 None
2026-03-30 07:33:02 [auto1.de] INFO: Saving data for BN15380: {'auction_closing_time': 1774972280.0, 'created_time': 1773688746.033032, 'last_price_update_time': 1774855982.75706}
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN15380') HTTP/1.1" 204 0
2026-03-30 07:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb772a61-e74c-5966-86de-44e7b36fa8c1 with identifier: GM10989
2026-03-30 07:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb772a61-e74c-5966-86de-44e7b36fa8c1 with identifier: GM10989
2026-03-30 07:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb772a61-e74c-5966-86de-44e7b36fa8c1 with identifier: GM10989 to the API
2026-03-30 07:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:05Z',
 'fuel_type': 'diesel',
 'id': 'eb772a61-e74c-5966-86de-44e7b36fa8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM10989',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 45208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Life 4Motion',
 'transmission': 'automatic',
 'trim': 'Life 4Motion',
 'year': 2022}
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM10989%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [auto1.de] INFO: Saving data for GM10989: {'auction_closing_time': 1774969625.0, 'created_time': 1774293197.355978, 'last_price_update_time': 1774855983.213405}
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM10989') HTTP/1.1" 204 0
2026-03-30 07:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70431815-36d0-51e2-8b0d-9afa14375feb with identifier: DR13547
2026-03-30 07:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70431815-36d0-51e2-8b0d-9afa14375feb with scrape type 1
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70431815-36d0-51e2-8b0d-9afa14375feb
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_71ba688f76d537ccec6d068d0438fece.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_71ba688f76d537ccec6d068d0438fece.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_e548cf6badb10e6d6bbfb606a29d71bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_e548cf6badb10e6d6bbfb606a29d71bf.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_43f8bfa1756c413ff3d662fdb8e6b35e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_43f8bfa1756c413ff3d662fdb8e6b35e.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_6a5084cdc125eae305f527fbcdacdb87.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6a5084cdc125eae305f527fbcdacdb87.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_acfa9ef8e7a9f3a836a28f11847121a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_acfa9ef8e7a9f3a836a28f11847121a3.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_b2fbad21e0e56fd891a056ad804ec18e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_b2fbad21e0e56fd891a056ad804ec18e.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_a68f2f0d878d1232c326ba5b21d42b27.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_a68f2f0d878d1232c326ba5b21d42b27.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_eb27cd5aeeb141da97fdd5f421a43945.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_eb27cd5aeeb141da97fdd5f421a43945.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_76482ddc56e544b73f3e030b3265ea03.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_76482ddc56e544b73f3e030b3265ea03.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F85%252Fac852370bd726cd29306ad1480477f55%252Fpa%252FDR13547_6657f5099d3d3456dd13ba5ee1446ab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6657f5099d3d3456dd13ba5ee1446ab5.jpg already downloaded
2026-03-30 07:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70431815-36d0-51e2-8b0d-9afa14375feb, identifier: DR13547
2026-03-30 07:33:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc46ae90>
2026-03-30 07:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F99%252F4499cef1a2317d2bbc0d0373aa2a82ac%252Fpa%252FTC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg saved to cache
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd89330a-0bfa-56dd-a3d7-17008f2814b5
2026-03-30 07:33:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd89330a-0bfa-56dd-a3d7-17008f2814b5, skipping ID generation
2026-03-30 07:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd89330a-0bfa-56dd-a3d7-17008f2814b5 with scrape type 1
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd89330a-0bfa-56dd-a3d7-17008f2814b5 sending to next pipeline
2026-03-30 07:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd89330a-0bfa-56dd-a3d7-17008f2814b5, identifier: TC34492
2026-03-30 07:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbcf4bea-67d5-5965-b71c-9587148f5b9a with identifier: NT12498
2026-03-30 07:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbcf4bea-67d5-5965-b71c-9587148f5b9a with scrape type 1
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbcf4bea-67d5-5965-b71c-9587148f5b9a
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_a3db9a7fe113d636ba8351fbe12b6d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_a3db9a7fe113d636ba8351fbe12b6d3d.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_fc3e0887d2fb8ff7f2620f4ed6281631.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_fc3e0887d2fb8ff7f2620f4ed6281631.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_e34b74452ca33f42a3208f7cd1f38db3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_e34b74452ca33f42a3208f7cd1f38db3.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_ebe8fe57389551b017cbf2ad553b20bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebe8fe57389551b017cbf2ad553b20bd.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_579ea11ca7bcba19a7879e785e253326.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_579ea11ca7bcba19a7879e785e253326.jpg already downloaded
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_4a334997db5dc39fcf3f1028580a788c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_4a334997db5dc39fcf3f1028580a788c.jpg already downloaded
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_cae38a740726f2618566331cf855bf33.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_cae38a740726f2618566331cf855bf33.jpg already downloaded
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_340a5f04b2addec87b52dc8ccdb9a001.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_340a5f04b2addec87b52dc8ccdb9a001.jpg already downloaded
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_9d802c1c5adb162d8c5d1e2ef88619de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_9d802c1c5adb162d8c5d1e2ef88619de.jpg already downloaded
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F02%252Fc30289cf12b5117b3a72c8b69c90b1ff%252Fpa%252FNT12498_ebd82a5862fba2adea24a9b417131542.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebd82a5862fba2adea24a9b417131542.jpg already downloaded
2026-03-30 07:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbcf4bea-67d5-5965-b71c-9587148f5b9a, identifier: NT12498
2026-03-30 07:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380
2026-03-30 07:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380
2026-03-30 07:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05186133-85f3-59e1-b050-e4fdd6daaee3 with identifier: BN15380 to the API
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:51:20Z',
 'fuel_type': 'petrol',
 'id': '05186133-85f3-59e1-b050-e4fdd6daaee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN15380',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 35435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN15380%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [auto1.de] INFO: Saving data for BN15380: {'auction_closing_time': 1774972280.0, 'created_time': 1773688746.033032, 'last_price_update_time': 1774855984.55826}
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN15380') HTTP/1.1" 204 0
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM10989%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [auto1.de] INFO: Scrape type for GM10989: 0
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [auto1.de] INFO: Scrape type for MY20439: 2
2026-03-30 07:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439
2026-03-30 07:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe79f52b-5e97-5864-9da0-b3aa380d6232 with scrape type 2
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe79f52b-5e97-5864-9da0-b3aa380d6232 with scrape type 2
2026-03-30 07:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe79f52b-5e97-5864-9da0-b3aa380d6232, identifier: MY20439
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 07:33:04 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-30 07:33:04 [auto1.de] INFO: Scrape type for MY20439: 2
2026-03-30 07:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe79f52b-5e97-5864-9da0-b3aa380d6232 with scrape type 2
2026-03-30 07:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe79f52b-5e97-5864-9da0-b3aa380d6232 with scrape type 2
2026-03-30 07:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe79f52b-5e97-5864-9da0-b3aa380d6232, identifier: MY20439
2026-03-30 07:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB45196> (referer: https://www.auto1.com/v1/car-details-view/JB45196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70431815-36d0-51e2-8b0d-9afa14375feb with identifier: DR13547
2026-03-30 07:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70431815-36d0-51e2-8b0d-9afa14375feb with identifier: DR13547
2026-03-30 07:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70431815-36d0-51e2-8b0d-9afa14375feb with identifier: DR13547 to the API
2026-03-30 07:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR13547>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:56Z',
 'fuel_type': 'petrol',
 'id': '70431815-36d0-51e2-8b0d-9afa14375feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR13547',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 23634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_71ba688f76d537ccec6d068d0438fece.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_e548cf6badb10e6d6bbfb606a29d71bf.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_43f8bfa1756c413ff3d662fdb8e6b35e.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6a5084cdc125eae305f527fbcdacdb87.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_acfa9ef8e7a9f3a836a28f11847121a3.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_b2fbad21e0e56fd891a056ad804ec18e.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_a68f2f0d878d1232c326ba5b21d42b27.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_eb27cd5aeeb141da97fdd5f421a43945.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_76482ddc56e544b73f3e030b3265ea03.jpg',
                'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6657f5099d3d3456dd13ba5ee1446ab5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_71ba688f76d537ccec6d068d0438fece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_e548cf6badb10e6d6bbfb606a29d71bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_43f8bfa1756c413ff3d662fdb8e6b35e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6a5084cdc125eae305f527fbcdacdb87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_acfa9ef8e7a9f3a836a28f11847121a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_b2fbad21e0e56fd891a056ad804ec18e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_a68f2f0d878d1232c326ba5b21d42b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_eb27cd5aeeb141da97fdd5f421a43945.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_76482ddc56e544b73f3e030b3265ea03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70431815-36d0-51e2-8b0d-9afa14375feb/70431815-36d0-51e2-8b0d-9afa14375feb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/85/ac852370bd726cd29306ad1480477f55/pa/DR13547_6657f5099d3d3456dd13ba5ee1446ab5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR13547%27 HTTP/1.1" 200 None
2026-03-30 07:33:05 [auto1.de] INFO: Saving data for DR13547: {'created_time': 1774855985.167556, 'last_price_update_time': 1774855985.167572, 'auction_closing_time': 1774969376.0}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR13547') HTTP/1.1" 204 0
2026-03-30 07:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd89330a-0bfa-56dd-a3d7-17008f2814b5 with identifier: TC34492
2026-03-30 07:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd89330a-0bfa-56dd-a3d7-17008f2814b5 with identifier: TC34492
2026-03-30 07:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd89330a-0bfa-56dd-a3d7-17008f2814b5 with identifier: TC34492 to the API
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 264,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '5.0L',
 'engine_horse_power': 385,
 'expiration_date': '2026-03-31T15:02:07Z',
 'fuel_type': 'petrol',
 'id': 'cd89330a-0bfa-56dd-a3d7-17008f2814b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC34492',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Jaguar',
 'model': 'XK',
 'odometer': 91421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_26265ba5e7e8e301438bb2ab1e0506a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_826628e5ab932a1b34c63160ca301a3e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_5970bf5c2e830ed2ef2bfdacda7f893b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_ea343fc93eb22b6b1d939aa012892d61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_8d2f07ad664e87ee13ceac7ca21158f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2781817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_017370993409338ade27f6c9cfb1a16c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_1f2830fc392c43cdba93253f5ad29842.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_a64ac7caeb6d3006f6dcaf7d44a84acf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2937144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_66dad4b8c21fab356b49e3d49aa9688e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd89330a-0bfa-56dd-a3d7-17008f2814b5/cd89330a-0bfa-56dd-a3d7-17008f2814b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/99/4499cef1a2317d2bbc0d0373aa2a82ac/pa/TC34492_320a02f0381c2f5c7520db94b76a462f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Jaguar XK 5.0 V8',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC34492%27 HTTP/1.1" 200 None
2026-03-30 07:33:05 [auto1.de] INFO: Saving data for TC34492: {'created_time': 1774855985.577339, 'last_price_update_time': 1774855985.577351, 'auction_closing_time': 1774969327.0}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC34492') HTTP/1.1" 204 0
2026-03-30 07:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbcf4bea-67d5-5965-b71c-9587148f5b9a with identifier: NT12498
2026-03-30 07:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbcf4bea-67d5-5965-b71c-9587148f5b9a with identifier: NT12498
2026-03-30 07:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbcf4bea-67d5-5965-b71c-9587148f5b9a with identifier: NT12498 to the API
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT12498>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:56:08Z',
 'fuel_type': 'diesel',
 'id': 'cbcf4bea-67d5-5965-b71c-9587148f5b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT12498',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 276337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_a3db9a7fe113d636ba8351fbe12b6d3d.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_fc3e0887d2fb8ff7f2620f4ed6281631.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_e34b74452ca33f42a3208f7cd1f38db3.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebe8fe57389551b017cbf2ad553b20bd.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_579ea11ca7bcba19a7879e785e253326.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_4a334997db5dc39fcf3f1028580a788c.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_cae38a740726f2618566331cf855bf33.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_340a5f04b2addec87b52dc8ccdb9a001.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_9d802c1c5adb162d8c5d1e2ef88619de.jpg',
                'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebd82a5862fba2adea24a9b417131542.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_a3db9a7fe113d636ba8351fbe12b6d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_fc3e0887d2fb8ff7f2620f4ed6281631.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_e34b74452ca33f42a3208f7cd1f38db3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebe8fe57389551b017cbf2ad553b20bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_579ea11ca7bcba19a7879e785e253326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_4a334997db5dc39fcf3f1028580a788c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_cae38a740726f2618566331cf855bf33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_340a5f04b2addec87b52dc8ccdb9a001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_9d802c1c5adb162d8c5d1e2ef88619de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbcf4bea-67d5-5965-b71c-9587148f5b9a/cbcf4bea-67d5-5965-b71c-9587148f5b9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/02/c30289cf12b5117b3a72c8b69c90b1ff/pa/NT12498_ebd82a5862fba2adea24a9b417131542.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-11-07',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI Atlantis',
 'transmission': 'manual',
 'trim': 'Atlantis',
 'year': 2002}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT12498%27 HTTP/1.1" 200 None
2026-03-30 07:33:05 [auto1.de] INFO: Saving data for NT12498: {'created_time': 1774855985.955401, 'last_price_update_time': 1774855985.955412, 'auction_closing_time': 1774972568.0}
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT12498') HTTP/1.1" 204 0
2026-03-30 07:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_fc9ab316dc71f25f587801f4353365d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:05 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 07:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439
2026-03-30 07:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439
2026-03-30 07:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439 to the API
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:49:26Z',
 'fuel_type': 'diesel',
 'id': 'fe79f52b-5e97-5864-9da0-b3aa380d6232',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY20439',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 103809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Opel Insignia 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-30 07:33:06 [auto1.de] INFO: Saving data for MY20439: {'auction_closing_time': 1774972166.0, 'created_time': 1773660500.953027, 'last_price_update_time': 1774855986.319875}
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY20439') HTTP/1.1" 204 0
2026-03-30 07:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439
2026-03-30 07:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439
2026-03-30 07:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe79f52b-5e97-5864-9da0-b3aa380d6232 with identifier: MY20439 to the API
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:49:26Z',
 'fuel_type': 'diesel',
 'id': 'fe79f52b-5e97-5864-9da0-b3aa380d6232',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY20439',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 103809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Opel Insignia 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-30 07:33:06 [auto1.de] INFO: Saving data for MY20439: {'auction_closing_time': 1774972166.0, 'created_time': 1773660500.953027, 'last_price_update_time': 1774855986.748858}
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY20439') HTTP/1.1" 204 0
2026-03-30 07:33:06 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 45 pages/min), scraped 168 items (at 61 items/min)
2026-03-30 07:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:33:06 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-30 07:33:06 [auto1.de] INFO: Scrape type for MM40978: 2
2026-03-30 07:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978
2026-03-30 07:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3edda70c-29a9-50eb-b43b-0244d4271fdc with scrape type 2
2026-03-30 07:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3edda70c-29a9-50eb-b43b-0244d4271fdc with scrape type 2
2026-03-30 07:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3edda70c-29a9-50eb-b43b-0244d4271fdc, identifier: MM40978
2026-03-30 07:33:06 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-30 07:33:06 [auto1.de] INFO: Scrape type for MM40978: 2
2026-03-30 07:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3edda70c-29a9-50eb-b43b-0244d4271fdc with scrape type 2
2026-03-30 07:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3edda70c-29a9-50eb-b43b-0244d4271fdc with scrape type 2
2026-03-30 07:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3edda70c-29a9-50eb-b43b-0244d4271fdc, identifier: MM40978
2026-03-30 07:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL17171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW55090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc9ea51a-f277-5d36-94f6-611a2480fedc with identifier: GT95887
2026-03-30 07:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc9ea51a-f277-5d36-94f6-611a2480fedc with scrape type 1
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc9ea51a-f277-5d36-94f6-611a2480fedc
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_80dfc0772c80cd0e68623db577bc632c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_80dfc0772c80cd0e68623db577bc632c.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_618fba24ddd7813f5eeca8803201378f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_618fba24ddd7813f5eeca8803201378f.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_6aa52245430c94b210e118e0b22f7a78.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6aa52245430c94b210e118e0b22f7a78.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_2407237d2ad86fb4b52d2c3868aeedbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_2407237d2ad86fb4b52d2c3868aeedbd.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_8cc663b11f4285d632bad77fcad33477.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_8cc663b11f4285d632bad77fcad33477.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_6392f3e20b46d6f5e08e5826e7ca7efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6392f3e20b46d6f5e08e5826e7ca7efc.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_86de8ca3f9136501518e09339bb45854.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_86de8ca3f9136501518e09339bb45854.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_ae096c7743cb657852cf105d81ff8cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_ae096c7743cb657852cf105d81ff8cd2.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_3c973c8a515a5560c089cec7ab7e165c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_3c973c8a515a5560c089cec7ab7e165c.jpg already downloaded
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F60%252Fc5605c1e7da86b945c77dc381fb4d511%252Fpa%252FGT95887_90196775bffaba2bd1e31217e18dd752.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_90196775bffaba2bd1e31217e18dd752.jpg already downloaded
2026-03-30 07:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc9ea51a-f277-5d36-94f6-611a2480fedc, identifier: GT95887
2026-03-30 07:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978
2026-03-30 07:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978
2026-03-30 07:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978 to the API
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:07:24Z',
 'fuel_type': 'petrol',
 'id': '3edda70c-29a9-50eb-b43b-0244d4271fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM40978',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 184296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-19',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-30 07:33:07 [auto1.de] INFO: Saving data for MM40978: {'auction_closing_time': 1774969644.0, 'created_time': 1773344083.014748, 'last_price_update_time': 1774855987.878718}
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM40978') HTTP/1.1" 204 0
2026-03-30 07:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978
2026-03-30 07:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978
2026-03-30 07:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3edda70c-29a9-50eb-b43b-0244d4271fdc with identifier: MM40978 to the API
2026-03-30 07:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:07:24Z',
 'fuel_type': 'petrol',
 'id': '3edda70c-29a9-50eb-b43b-0244d4271fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM40978',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 184296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-19',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-30 07:33:08 [auto1.de] INFO: Saving data for MM40978: {'auction_closing_time': 1774969644.0, 'created_time': 1773344083.014748, 'last_price_update_time': 1774855988.256896}
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM40978') HTTP/1.1" 204 0
2026-03-30 07:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc9ea51a-f277-5d36-94f6-611a2480fedc with identifier: GT95887
2026-03-30 07:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc9ea51a-f277-5d36-94f6-611a2480fedc with identifier: GT95887
2026-03-30 07:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc9ea51a-f277-5d36-94f6-611a2480fedc with identifier: GT95887 to the API
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GT95887>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:59:20Z',
 'fuel_type': 'diesel',
 'id': 'fc9ea51a-f277-5d36-94f6-611a2480fedc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT95887',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 174888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_80dfc0772c80cd0e68623db577bc632c.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_618fba24ddd7813f5eeca8803201378f.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6aa52245430c94b210e118e0b22f7a78.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_2407237d2ad86fb4b52d2c3868aeedbd.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_8cc663b11f4285d632bad77fcad33477.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6392f3e20b46d6f5e08e5826e7ca7efc.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_86de8ca3f9136501518e09339bb45854.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_ae096c7743cb657852cf105d81ff8cd2.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_3c973c8a515a5560c089cec7ab7e165c.jpg',
                'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_90196775bffaba2bd1e31217e18dd752.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_80dfc0772c80cd0e68623db577bc632c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_618fba24ddd7813f5eeca8803201378f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6aa52245430c94b210e118e0b22f7a78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_2407237d2ad86fb4b52d2c3868aeedbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_8cc663b11f4285d632bad77fcad33477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_6392f3e20b46d6f5e08e5826e7ca7efc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_86de8ca3f9136501518e09339bb45854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_ae096c7743cb657852cf105d81ff8cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_3c973c8a515a5560c089cec7ab7e165c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc9ea51a-f277-5d36-94f6-611a2480fedc/fc9ea51a-f277-5d36-94f6-611a2480fedc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/60/c5605c1e7da86b945c77dc381fb4d511/pa/GT95887_90196775bffaba2bd1e31217e18dd752.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95887%27 HTTP/1.1" 200 None
2026-03-30 07:33:08 [auto1.de] INFO: Saving data for GT95887: {'created_time': 1774855988.854292, 'last_price_update_time': 1774855988.854304, 'auction_closing_time': 1774972760.0}
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT95887') HTTP/1.1" 204 0
2026-03-30 07:33:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:08 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 07:33:08 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-30 07:33:08 [auto1.de] INFO: Scrape type for NZ57035: 2
2026-03-30 07:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035
2026-03-30 07:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with scrape type 2
2026-03-30 07:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with scrape type 2
2026-03-30 07:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac, identifier: NZ57035
2026-03-30 07:33:08 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 07:33:09 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [auto1.de] INFO: Scrape type for NZ57035: 2
2026-03-30 07:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with scrape type 2
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with scrape type 2
2026-03-30 07:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac, identifier: NZ57035
2026-03-30 07:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7e6191-a943-5ada-8173-ce0980b487eb with identifier: JB45196
2026-03-30 07:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7e6191-a943-5ada-8173-ce0980b487eb with scrape type 1
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1b7e6191-a943-5ada-8173-ce0980b487eb
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4a7e9396519332f68db0078741f9c2%252Fpa%252FJB45196_42f49587130b1e3191bf5a33896f36af.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_42f49587130b1e3191bf5a33896f36af.jpg already downloaded
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4a7e9396519332f68db0078741f9c2%252Fpa%252FJB45196_a821bccade3ea5167eea218a2142aa9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_a821bccade3ea5167eea218a2142aa9a.jpg already downloaded
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4a7e9396519332f68db0078741f9c2%252Fpa%252FJB45196_0348acdaa82c6f97a0cf2d4b3c2272ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_0348acdaa82c6f97a0cf2d4b3c2272ee.jpg already downloaded
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4a7e9396519332f68db0078741f9c2%252Fpa%252FJB45196_f61b958b4d9f96fe866a1f8819f5ad0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f61b958b4d9f96fe866a1f8819f5ad0c.jpg already downloaded
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4a7e9396519332f68db0078741f9c2%252Fpa%252FJB45196_f6af67e218a86c9e05e16b42a8700e69.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f6af67e218a86c9e05e16b42a8700e69.jpg already downloaded
2026-03-30 07:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b7e6191-a943-5ada-8173-ce0980b487eb, identifier: JB45196
2026-03-30 07:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3190d0>
2026-03-30 07:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_fc9ab316dc71f25f587801f4353365d6.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_fc9ab316dc71f25f587801f4353365d6.jpg saved to cache
2026-03-30 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035
2026-03-30 07:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035
2026-03-30 07:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035 to the API
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:15:43Z',
 'fuel_type': 'petrol',
 'id': '9d88ce59-0ca0-5037-bc7a-cf65d38c0dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ57035',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 87767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort + 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort + 4x4',
 'year': 2018}
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-30 07:33:09 [auto1.de] INFO: Saving data for NZ57035: {'auction_closing_time': 1774970143.0, 'created_time': 1773774472.429418, 'last_price_update_time': 1774855989.655993}
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ57035') HTTP/1.1" 204 0
2026-03-30 07:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035
2026-03-30 07:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035
2026-03-30 07:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d88ce59-0ca0-5037-bc7a-cf65d38c0dac with identifier: NZ57035 to the API
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:15:43Z',
 'fuel_type': 'petrol',
 'id': '9d88ce59-0ca0-5037-bc7a-cf65d38c0dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ57035',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 87767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort + 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort + 4x4',
 'year': 2018}
2026-03-30 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-30 07:33:10 [auto1.de] INFO: Saving data for NZ57035: {'auction_closing_time': 1774970143.0, 'created_time': 1773774472.429418, 'last_price_update_time': 1774855990.002571}
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ57035') HTTP/1.1" 204 0
2026-03-30 07:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b7e6191-a943-5ada-8173-ce0980b487eb with identifier: JB45196
2026-03-30 07:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b7e6191-a943-5ada-8173-ce0980b487eb with identifier: JB45196
2026-03-30 07:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b7e6191-a943-5ada-8173-ce0980b487eb with identifier: JB45196 to the API
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB45196>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:48:36Z',
 'fuel_type': 'petrol',
 'id': '1b7e6191-a943-5ada-8173-ce0980b487eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB45196',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 107666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_42f49587130b1e3191bf5a33896f36af.jpg',
                'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_a821bccade3ea5167eea218a2142aa9a.jpg',
                'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_0348acdaa82c6f97a0cf2d4b3c2272ee.jpg',
                'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f61b958b4d9f96fe866a1f8819f5ad0c.jpg',
                'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f6af67e218a86c9e05e16b42a8700e69.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7e6191-a943-5ada-8173-ce0980b487eb/1b7e6191-a943-5ada-8173-ce0980b487eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_42f49587130b1e3191bf5a33896f36af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7e6191-a943-5ada-8173-ce0980b487eb/1b7e6191-a943-5ada-8173-ce0980b487eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_a821bccade3ea5167eea218a2142aa9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7e6191-a943-5ada-8173-ce0980b487eb/1b7e6191-a943-5ada-8173-ce0980b487eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_0348acdaa82c6f97a0cf2d4b3c2272ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7e6191-a943-5ada-8173-ce0980b487eb/1b7e6191-a943-5ada-8173-ce0980b487eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f61b958b4d9f96fe866a1f8819f5ad0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b7e6191-a943-5ada-8173-ce0980b487eb/1b7e6191-a943-5ada-8173-ce0980b487eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4a7e9396519332f68db0078741f9c2/pa/JB45196_f6af67e218a86c9e05e16b42a8700e69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2007}
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB45196%27 HTTP/1.1" 200 None
2026-03-30 07:33:10 [auto1.de] INFO: Saving data for JB45196: {'created_time': 1774855990.343428, 'last_price_update_time': 1774855990.343439, 'auction_closing_time': 1774972116.0}
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB45196') HTTP/1.1" 204 0
2026-03-30 07:33:10 [auto1.de] INFO: Found listing with ID: FT91283
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91283%27 HTTP/1.1" 200 None
2026-03-30 07:33:10 [auto1.de] INFO: Scrape type for FT91283: 2
2026-03-30 07:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283
2026-03-30 07:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87965c8b-4ec2-5408-9282-9cf2288348cd with scrape type 2
2026-03-30 07:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87965c8b-4ec2-5408-9282-9cf2288348cd with scrape type 2
2026-03-30 07:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87965c8b-4ec2-5408-9282-9cf2288348cd, identifier: FT91283
2026-03-30 07:33:10 [auto1.de] INFO: Found listing with ID: FT91283
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91283%27 HTTP/1.1" 200 None
2026-03-30 07:33:10 [auto1.de] INFO: Scrape type for FT91283: 2
2026-03-30 07:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87965c8b-4ec2-5408-9282-9cf2288348cd with scrape type 2
2026-03-30 07:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87965c8b-4ec2-5408-9282-9cf2288348cd with scrape type 2
2026-03-30 07:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87965c8b-4ec2-5408-9282-9cf2288348cd, identifier: FT91283
2026-03-30 07:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 07:33:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283
2026-03-30 07:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283 to the API
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:28:51Z',
 'fuel_type': 'diesel',
 'id': '87965c8b-4ec2-5408-9282-9cf2288348cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT91283',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91283%27 HTTP/1.1" 200 None
2026-03-30 07:33:11 [auto1.de] INFO: Saving data for FT91283: {'auction_closing_time': 1774970931.0, 'created_time': 1773686750.644163, 'last_price_update_time': 1774855991.108727}
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT91283') HTTP/1.1" 204 0
2026-03-30 07:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283
2026-03-30 07:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283
2026-03-30 07:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87965c8b-4ec2-5408-9282-9cf2288348cd with identifier: FT91283 to the API
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:28:51Z',
 'fuel_type': 'diesel',
 'id': '87965c8b-4ec2-5408-9282-9cf2288348cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT91283',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91283%27 HTTP/1.1" 200 None
2026-03-30 07:33:11 [auto1.de] INFO: Saving data for FT91283: {'auction_closing_time': 1774970931.0, 'created_time': 1773686750.644163, 'last_price_update_time': 1774855991.409177}
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT91283') HTTP/1.1" 204 0
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: LH58112
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: HJ00196
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ00196%27 HTTP/1.1" 200 None
2026-03-30 07:33:11 [auto1.de] INFO: Scrape type for HJ00196: 1
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: LH58112
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: HJ00196
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: CD55313
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD55313%27 HTTP/1.1" 200 None
2026-03-30 07:33:11 [auto1.de] INFO: Scrape type for CD55313: 2
2026-03-30 07:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313
2026-03-30 07:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with scrape type 2
2026-03-30 07:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with scrape type 2
2026-03-30 07:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c, identifier: CD55313
2026-03-30 07:33:11 [auto1.de] INFO: Found listing with ID: CD55313
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD55313%27 HTTP/1.1" 200 None
2026-03-30 07:33:11 [auto1.de] INFO: Scrape type for CD55313: 2
2026-03-30 07:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with scrape type 2
2026-03-30 07:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with scrape type 2
2026-03-30 07:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c, identifier: CD55313
2026-03-30 07:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN83607> (referer: https://www.auto1.com/v1/car-details-view/DN83607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW76258> (referer: https://www.auto1.com/v1/car-details-view/EW76258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313
2026-03-30 07:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313
2026-03-30 07:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313 to the API
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:25:13Z',
 'fuel_type': 'petrol',
 'id': '5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD55313',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 50124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2019}
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD55313%27 HTTP/1.1" 200 None
2026-03-30 07:33:12 [auto1.de] INFO: Saving data for CD55313: {'auction_closing_time': 1774970713.0, 'created_time': 1773688905.172134, 'last_price_update_time': 1774855992.089345}
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD55313') HTTP/1.1" 204 0
2026-03-30 07:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313
2026-03-30 07:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313
2026-03-30 07:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c with identifier: CD55313 to the API
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:25:13Z',
 'fuel_type': 'petrol',
 'id': '5ad56d6d-61f8-5e40-aa39-e82bd9a84b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD55313',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 50124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2019}
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD55313%27 HTTP/1.1" 200 None
2026-03-30 07:33:12 [auto1.de] INFO: Saving data for CD55313: {'auction_closing_time': 1774970713.0, 'created_time': 1773688905.172134, 'last_price_update_time': 1774855992.488578}
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD55313') HTTP/1.1" 204 0
2026-03-30 07:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:12 [auto1.de] INFO: Found listing with ID: LY25058
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY25058%27 HTTP/1.1" 200 None
2026-03-30 07:33:12 [auto1.de] INFO: Scrape type for LY25058: 2
2026-03-30 07:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058
2026-03-30 07:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f58215a7-5ebd-5084-b2c8-1aac9f17151c with scrape type 2
2026-03-30 07:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f58215a7-5ebd-5084-b2c8-1aac9f17151c with scrape type 2
2026-03-30 07:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f58215a7-5ebd-5084-b2c8-1aac9f17151c, identifier: LY25058
2026-03-30 07:33:12 [auto1.de] INFO: Found listing with ID: LY25058
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY25058%27 HTTP/1.1" 200 None
2026-03-30 07:33:12 [auto1.de] INFO: Scrape type for LY25058: 2
2026-03-30 07:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f58215a7-5ebd-5084-b2c8-1aac9f17151c with scrape type 2
2026-03-30 07:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f58215a7-5ebd-5084-b2c8-1aac9f17151c with scrape type 2
2026-03-30 07:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f58215a7-5ebd-5084-b2c8-1aac9f17151c, identifier: LY25058
2026-03-30 07:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058
2026-03-30 07:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058
2026-03-30 07:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058 to the API
2026-03-30 07:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-31T15:24:50Z',
 'fuel_type': 'diesel',
 'id': 'f58215a7-5ebd-5084-b2c8-1aac9f17151c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY25058',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 113118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY25058%27 HTTP/1.1" 200 None
2026-03-30 07:33:13 [auto1.de] INFO: Saving data for LY25058: {'auction_closing_time': 1774970690.0, 'created_time': 1773467392.468199, 'last_price_update_time': 1774855993.521875}
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY25058') HTTP/1.1" 204 0
2026-03-30 07:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058
2026-03-30 07:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058
2026-03-30 07:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f58215a7-5ebd-5084-b2c8-1aac9f17151c with identifier: LY25058 to the API
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-31T15:24:50Z',
 'fuel_type': 'diesel',
 'id': 'f58215a7-5ebd-5084-b2c8-1aac9f17151c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY25058',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 113118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY25058%27 HTTP/1.1" 200 None
2026-03-30 07:33:13 [auto1.de] INFO: Saving data for LY25058: {'auction_closing_time': 1774970690.0, 'created_time': 1773467392.468199, 'last_price_update_time': 1774855993.805421}
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY25058') HTTP/1.1" 204 0
2026-03-30 07:33:13 [auto1.de] INFO: Found listing with ID: FA41844
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA41844%27 HTTP/1.1" 200 None
2026-03-30 07:33:13 [auto1.de] INFO: Scrape type for FA41844: 2
2026-03-30 07:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844
2026-03-30 07:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69272651-934c-526e-be9f-8147ac5b8fa2 with scrape type 2
2026-03-30 07:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69272651-934c-526e-be9f-8147ac5b8fa2 with scrape type 2
2026-03-30 07:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69272651-934c-526e-be9f-8147ac5b8fa2, identifier: FA41844
2026-03-30 07:33:13 [auto1.de] INFO: Found listing with ID: FA41844
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA41844%27 HTTP/1.1" 200 None
2026-03-30 07:33:13 [auto1.de] INFO: Scrape type for FA41844: 2
2026-03-30 07:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69272651-934c-526e-be9f-8147ac5b8fa2 with scrape type 2
2026-03-30 07:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69272651-934c-526e-be9f-8147ac5b8fa2 with scrape type 2
2026-03-30 07:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69272651-934c-526e-be9f-8147ac5b8fa2, identifier: FA41844
2026-03-30 07:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW74261> (referer: https://www.auto1.com/v1/car-details-view/RW74261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844
2026-03-30 07:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844
2026-03-30 07:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844 to the API
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:18:33Z',
 'fuel_type': 'diesel',
 'id': '69272651-934c-526e-be9f-8147ac5b8fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA41844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 66462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-03',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 mittellang Hochdach FWD',
 'year': 2023}
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA41844%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [auto1.de] INFO: Saving data for FA41844: {'auction_closing_time': 1774970313.0, 'created_time': 1773773581.585379, 'last_price_update_time': 1774855994.396725}
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA41844') HTTP/1.1" 204 0
2026-03-30 07:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844
2026-03-30 07:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844
2026-03-30 07:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69272651-934c-526e-be9f-8147ac5b8fa2 with identifier: FA41844 to the API
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:18:33Z',
 'fuel_type': 'diesel',
 'id': '69272651-934c-526e-be9f-8147ac5b8fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA41844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 66462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-03',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 mittellang Hochdach FWD',
 'year': 2023}
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA41844%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [auto1.de] INFO: Saving data for FA41844: {'auction_closing_time': 1774970313.0, 'created_time': 1773773581.585379, 'last_price_update_time': 1774855994.70299}
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA41844') HTTP/1.1" 204 0
2026-03-30 07:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0edba9f-59d8-5fa7-9f93-3f82671bf730 with identifier: DN83607
2026-03-30 07:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0edba9f-59d8-5fa7-9f93-3f82671bf730 with scrape type 1
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0edba9f-59d8-5fa7-9f93-3f82671bf730
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_861def2b7e1ef6e8d242635898816e78.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_861def2b7e1ef6e8d242635898816e78.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_eba48d9902d6c59deb826944a7a2c2b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_eba48d9902d6c59deb826944a7a2c2b3.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_3f23758a7d3fcafeb6a08b55622b3580.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_3f23758a7d3fcafeb6a08b55622b3580.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_7839b4ee93d2d8cc40a40f3c77ad0f85.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_7839b4ee93d2d8cc40a40f3c77ad0f85.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_72b20430e34d6b1aab8803fb5f7cc707.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_72b20430e34d6b1aab8803fb5f7cc707.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_ee8d887bccff24303cb33146d5470faf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_ee8d887bccff24303cb33146d5470faf.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_62b7bac793a40fd1429b5621c36611aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_62b7bac793a40fd1429b5621c36611aa.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_2f735b731cabc591bc920ececd288dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_2f735b731cabc591bc920ececd288dd4.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_55219a35d6f1cf0e082d4f0fe9f11902.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_55219a35d6f1cf0e082d4f0fe9f11902.jpg already downloaded
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F62%252F3462260d7701775826277621e5d5ce17%252Fpa%252FDN83607_39911327c8e7936f9b48367dce47026d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_39911327c8e7936f9b48367dce47026d.jpg already downloaded
2026-03-30 07:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0edba9f-59d8-5fa7-9f93-3f82671bf730, identifier: DN83607
2026-03-30 07:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a41573-6bec-5ab4-9703-82d3a220d5b0 with identifier: EW76258
2026-03-30 07:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a41573-6bec-5ab4-9703-82d3a220d5b0 with scrape type 1
2026-03-30 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_491e06050dd9e86432618c8e9d5b6314.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_491e06050dd9e86432618c8e9d5b6314.jpg not downloaded yet
2026-03-30 07:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ST24513
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ZY45638
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS74444%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [auto1.de] INFO: Scrape type for ZS74444: 1
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ST24513
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ZY45638
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 07:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE99980> (referer: https://www.auto1.com/v1/car-details-view/YE99980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0edba9f-59d8-5fa7-9f93-3f82671bf730 with identifier: DN83607
2026-03-30 07:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0edba9f-59d8-5fa7-9f93-3f82671bf730 with identifier: DN83607
2026-03-30 07:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0edba9f-59d8-5fa7-9f93-3f82671bf730 with identifier: DN83607 to the API
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN83607>
{'auction_title': '',
 'c_o_2_emission_value': 254,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:33:18Z',
 'fuel_type': 'diesel',
 'id': 'd0edba9f-59d8-5fa7-9f93-3f82671bf730',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN83607',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 178437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_861def2b7e1ef6e8d242635898816e78.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_eba48d9902d6c59deb826944a7a2c2b3.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_3f23758a7d3fcafeb6a08b55622b3580.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_7839b4ee93d2d8cc40a40f3c77ad0f85.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_72b20430e34d6b1aab8803fb5f7cc707.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_ee8d887bccff24303cb33146d5470faf.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_62b7bac793a40fd1429b5621c36611aa.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_2f735b731cabc591bc920ececd288dd4.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_55219a35d6f1cf0e082d4f0fe9f11902.jpg',
                'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_39911327c8e7936f9b48367dce47026d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_861def2b7e1ef6e8d242635898816e78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_eba48d9902d6c59deb826944a7a2c2b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_3f23758a7d3fcafeb6a08b55622b3580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_7839b4ee93d2d8cc40a40f3c77ad0f85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_72b20430e34d6b1aab8803fb5f7cc707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2698952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_ee8d887bccff24303cb33146d5470faf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_62b7bac793a40fd1429b5621c36611aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_2f735b731cabc591bc920ececd288dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_55219a35d6f1cf0e082d4f0fe9f11902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0edba9f-59d8-5fa7-9f93-3f82671bf730/d0edba9f-59d8-5fa7-9f93-3f82671bf730_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3225992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/62/3462260d7701775826277621e5d5ce17/pa/DN83607_39911327c8e7936f9b48367dce47026d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN83607%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [auto1.de] INFO: Saving data for DN83607: {'created_time': 1774855995.397517, 'last_price_update_time': 1774855995.397529, 'auction_closing_time': 1774971198.0}
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN83607') HTTP/1.1" 204 0
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_0851ef4b984e6b11588caa12b569a9cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0851ef4b984e6b11588caa12b569a9cc.jpg not downloaded yet
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [auto1.de] INFO: Scrape type for ET18482: 2
2026-03-30 07:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482
2026-03-30 07:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93546618-c875-51f4-88b4-d925967e04ae with scrape type 2
2026-03-30 07:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93546618-c875-51f4-88b4-d925967e04ae with scrape type 2
2026-03-30 07:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93546618-c875-51f4-88b4-d925967e04ae, identifier: ET18482
2026-03-30 07:33:15 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 07:33:15 [auto1.de] INFO: Scrape type for ET18482: 2
2026-03-30 07:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93546618-c875-51f4-88b4-d925967e04ae with scrape type 2
2026-03-30 07:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93546618-c875-51f4-88b4-d925967e04ae with scrape type 2
2026-03-30 07:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93546618-c875-51f4-88b4-d925967e04ae, identifier: ET18482
2026-03-30 07:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU83144> (referer: https://www.auto1.com/v1/car-details-view/MU83144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT75427> (referer: https://www.auto1.com/v1/car-details-view/HT75427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482
2026-03-30 07:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482
2026-03-30 07:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482 to the API
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:45:39Z',
 'fuel_type': 'petrol',
 'id': '93546618-c875-51f4-88b4-d925967e04ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [auto1.de] INFO: Saving data for ET18482: {'auction_closing_time': 1774971939.0, 'created_time': 1773469068.245445, 'last_price_update_time': 1774855996.014364}
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET18482') HTTP/1.1" 204 0
2026-03-30 07:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482
2026-03-30 07:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482
2026-03-30 07:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93546618-c875-51f4-88b4-d925967e04ae with identifier: ET18482 to the API
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:45:39Z',
 'fuel_type': 'petrol',
 'id': '93546618-c875-51f4-88b4-d925967e04ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [auto1.de] INFO: Saving data for ET18482: {'auction_closing_time': 1774971939.0, 'created_time': 1773469068.245445, 'last_price_update_time': 1774855996.391403}
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET18482') HTTP/1.1" 204 0
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_e53da30a39d27d2efa90c31457200b6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_e53da30a39d27d2efa90c31457200b6e.jpg not downloaded yet
2026-03-30 07:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:16 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 7363 | hits on page: 40
2026-03-30 07:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26 with identifier: RW74261
2026-03-30 07:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26 with scrape type 1
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_16ab174581238add6497680914889ea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_16ab174581238add6497680914889ea3.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_dfa4830045af0d363609887b86fbaa62.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_dfa4830045af0d363609887b86fbaa62.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_3669ac56455e857d9ef0c7831b51f53f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_3669ac56455e857d9ef0c7831b51f53f.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_d788fb17630f1f503e84b4b8cbd392b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_d788fb17630f1f503e84b4b8cbd392b9.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_1931e66b1d1c84ef8af157fe3647ad6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_1931e66b1d1c84ef8af157fe3647ad6c.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_a7390d3b91eaf0a34d00b397d8646d61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_a7390d3b91eaf0a34d00b397d8646d61.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_f5a2b17bde7b5f064b5ec195431b71f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_f5a2b17bde7b5f064b5ec195431b71f9.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_5862fc944e664b76254e8cfc3bc7ddd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_5862fc944e664b76254e8cfc3bc7ddd2.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_17e8554cc5f318d8c77255e1b0f42760.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_17e8554cc5f318d8c77255e1b0f42760.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8a%252F9e8a3af5c1c73e52f4a4a595f4ea67a3%252Fpa%252FRW74261_67b5781d14b34faf62d5ce91e0a07fe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_67b5781d14b34faf62d5ce91e0a07fe5.jpg already downloaded
2026-03-30 07:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26, identifier: RW74261
2026-03-30 07:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f330e20-347e-5764-85c8-b69251d1dcbf with identifier: YE99980
2026-03-30 07:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f330e20-347e-5764-85c8-b69251d1dcbf with scrape type 1
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f330e20-347e-5764-85c8-b69251d1dcbf
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_748c9176f874d6fdc4a7a4ef331d2c41.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_748c9176f874d6fdc4a7a4ef331d2c41.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_2d5a69d5bf2501b8be074894ab6bb6e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2d5a69d5bf2501b8be074894ab6bb6e8.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_221b67d310504e3afd04c6a25790f635.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_221b67d310504e3afd04c6a25790f635.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_160d66aafc3b57fd50bf54b93e989fb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_160d66aafc3b57fd50bf54b93e989fb9.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_9eb61a6f8b853400943710d081eae8fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_9eb61a6f8b853400943710d081eae8fc.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_814c5e51c320ef3a275aac93b225059a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_814c5e51c320ef3a275aac93b225059a.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_2c1c783a2e334d70ffbc805bbbea9221.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2c1c783a2e334d70ffbc805bbbea9221.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_10454fca59f7a61f14847594c240b2db.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_10454fca59f7a61f14847594c240b2db.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_79efaecbd9b3c63f58dfd9c83f94d352.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_79efaecbd9b3c63f58dfd9c83f94d352.jpg already downloaded
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fc8%252Ffec8d2a2896a8c54d15bd2fcae8160d2%252Fpa%252FYE99980_b1f1b58579ba279bd7d1ab7bd7ff9558.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_b1f1b58579ba279bd7d1ab7bd7ff9558.jpg already downloaded
2026-03-30 07:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f330e20-347e-5764-85c8-b69251d1dcbf, identifier: YE99980
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV80430%27 HTTP/1.1" 200 None
2026-03-30 07:33:17 [auto1.de] INFO: Scrape type for AV80430: 1
2026-03-30 07:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26 with identifier: RW74261
2026-03-30 07:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26 with identifier: RW74261
2026-03-30 07:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e96759d-cc75-5e3e-a96e-6a13fb1d4e26 with identifier: RW74261 to the API
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RW74261>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': 'Rental',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:08:17Z',
 'fuel_type': 'petrol',
 'id': '2e96759d-cc75-5e3e-a96e-6a13fb1d4e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW74261',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 123062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_16ab174581238add6497680914889ea3.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_dfa4830045af0d363609887b86fbaa62.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_3669ac56455e857d9ef0c7831b51f53f.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_d788fb17630f1f503e84b4b8cbd392b9.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_1931e66b1d1c84ef8af157fe3647ad6c.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_a7390d3b91eaf0a34d00b397d8646d61.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_f5a2b17bde7b5f064b5ec195431b71f9.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_5862fc944e664b76254e8cfc3bc7ddd2.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_17e8554cc5f318d8c77255e1b0f42760.jpg',
                'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_67b5781d14b34faf62d5ce91e0a07fe5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_16ab174581238add6497680914889ea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_dfa4830045af0d363609887b86fbaa62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_3669ac56455e857d9ef0c7831b51f53f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_d788fb17630f1f503e84b4b8cbd392b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_1931e66b1d1c84ef8af157fe3647ad6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_a7390d3b91eaf0a34d00b397d8646d61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_f5a2b17bde7b5f064b5ec195431b71f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_5862fc944e664b76254e8cfc3bc7ddd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_17e8554cc5f318d8c77255e1b0f42760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e96759d-cc75-5e3e-a96e-6a13fb1d4e26/2e96759d-cc75-5e3e-a96e-6a13fb1d4e26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8a/9e8a3af5c1c73e52f4a4a595f4ea67a3/pa/RW74261_67b5781d14b34faf62d5ce91e0a07fe5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW74261%27 HTTP/1.1" 200 None
2026-03-30 07:33:17 [auto1.de] INFO: Saving data for RW74261: {'created_time': 1774855997.356455, 'last_price_update_time': 1774855997.35647, 'auction_closing_time': 1774969697.0}
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW74261') HTTP/1.1" 204 0
2026-03-30 07:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f330e20-347e-5764-85c8-b69251d1dcbf with identifier: YE99980
2026-03-30 07:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f330e20-347e-5764-85c8-b69251d1dcbf with identifier: YE99980
2026-03-30 07:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f330e20-347e-5764-85c8-b69251d1dcbf with identifier: YE99980 to the API
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE99980>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:41:48Z',
 'fuel_type': 'petrol',
 'id': '1f330e20-347e-5764-85c8-b69251d1dcbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE99980',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 87949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_748c9176f874d6fdc4a7a4ef331d2c41.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2d5a69d5bf2501b8be074894ab6bb6e8.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_221b67d310504e3afd04c6a25790f635.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_160d66aafc3b57fd50bf54b93e989fb9.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_9eb61a6f8b853400943710d081eae8fc.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_814c5e51c320ef3a275aac93b225059a.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2c1c783a2e334d70ffbc805bbbea9221.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_10454fca59f7a61f14847594c240b2db.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_79efaecbd9b3c63f58dfd9c83f94d352.jpg',
                'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_b1f1b58579ba279bd7d1ab7bd7ff9558.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_748c9176f874d6fdc4a7a4ef331d2c41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2d5a69d5bf2501b8be074894ab6bb6e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_221b67d310504e3afd04c6a25790f635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_160d66aafc3b57fd50bf54b93e989fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_9eb61a6f8b853400943710d081eae8fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_814c5e51c320ef3a275aac93b225059a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_2c1c783a2e334d70ffbc805bbbea9221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_10454fca59f7a61f14847594c240b2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_79efaecbd9b3c63f58dfd9c83f94d352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f330e20-347e-5764-85c8-b69251d1dcbf/1f330e20-347e-5764-85c8-b69251d1dcbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/c8/fec8d2a2896a8c54d15bd2fcae8160d2/pa/YE99980_b1f1b58579ba279bd7d1ab7bd7ff9558.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE99980%27 HTTP/1.1" 200 None
2026-03-30 07:33:17 [auto1.de] INFO: Saving data for YE99980: {'created_time': 1774855997.759007, 'last_price_update_time': 1774855997.759021, 'auction_closing_time': 1774971708.0}
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE99980') HTTP/1.1" 204 0
2026-03-30 07:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_c366b46e4072c3241623772b508584b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_c366b46e4072c3241623772b508584b8.jpg not downloaded yet
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 07:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ00196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 07:33:17 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-30 07:33:17 [auto1.de] INFO: Scrape type for VS99519: 2
2026-03-30 07:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb756988-91e6-551b-87e9-5e253688995e with identifier: VS99519
2026-03-30 07:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb756988-91e6-551b-87e9-5e253688995e with scrape type 2
2026-03-30 07:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb756988-91e6-551b-87e9-5e253688995e with scrape type 2
2026-03-30 07:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb756988-91e6-551b-87e9-5e253688995e, identifier: VS99519
2026-03-30 07:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb756988-91e6-551b-87e9-5e253688995e with identifier: VS99519
2026-03-30 07:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb756988-91e6-551b-87e9-5e253688995e with identifier: VS99519
2026-03-30 07:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb756988-91e6-551b-87e9-5e253688995e with identifier: VS99519 to the API
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:48:57Z',
 'fuel_type': 'diesel',
 'id': 'eb756988-91e6-551b-87e9-5e253688995e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS99519',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 116602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2016}
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [auto1.de] INFO: Saving data for VS99519: {'auction_closing_time': 1774972137.0, 'created_time': 1774463613.91979, 'last_price_update_time': 1774855998.369606}
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS99519') HTTP/1.1" 204 0
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg not downloaded yet
2026-03-30 07:33:18 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET18482%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [auto1.de] INFO: Scrape type for ET18482: 0
2026-03-30 07:33:18 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 07:33:18 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 07:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c27bdca-c3fd-5b5b-8214-233b9ec4985a with identifier: MU83144
2026-03-30 07:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c27bdca-c3fd-5b5b-8214-233b9ec4985a with scrape type 1
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c27bdca-c3fd-5b5b-8214-233b9ec4985a
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_9e8206c766ce4aecb87c7fad36835512.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_9e8206c766ce4aecb87c7fad36835512.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_7470eab495da9154043c55908a7ab861.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_7470eab495da9154043c55908a7ab861.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_eaa3c9edfd616ba5d652763ab073d563.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_eaa3c9edfd616ba5d652763ab073d563.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_750d9365dee3f151e9bcd817f84aea12.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_750d9365dee3f151e9bcd817f84aea12.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_4c9e5dbc99990907193dce5596090319.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_4c9e5dbc99990907193dce5596090319.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_54cb24a7491ed84fff422618992c70bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_54cb24a7491ed84fff422618992c70bd.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_2da712b60aad3dc4e2c80085b3d93297.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_2da712b60aad3dc4e2c80085b3d93297.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_e54faea3be3a224a2fe9863a613a91f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_e54faea3be3a224a2fe9863a613a91f6.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_89c6cdc6881531ecaecd6f09f46fcbdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_89c6cdc6881531ecaecd6f09f46fcbdf.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F56%252F24560660f8f318471d063070b860c266%252Fpa%252FMU83144_03308c05ae918b8274c93c75c64c789c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_03308c05ae918b8274c93c75c64c789c.jpg already downloaded
2026-03-30 07:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c27bdca-c3fd-5b5b-8214-233b9ec4985a, identifier: MU83144
2026-03-30 07:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a236cd8b-eb03-5d14-8668-a23500f94e05 with identifier: HT75427
2026-03-30 07:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a236cd8b-eb03-5d14-8668-a23500f94e05 with scrape type 1
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a236cd8b-eb03-5d14-8668-a23500f94e05
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3b%252F083b580d47362b8ca73cf2e28b4b0644%252Fpa%252FHT75427_fb8505aa7f1ff9219e0fe23af141a05c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_fb8505aa7f1ff9219e0fe23af141a05c.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3b%252F083b580d47362b8ca73cf2e28b4b0644%252Fpa%252FHT75427_4a9119b9e2b16a078e1f3481ab90fb43.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_4a9119b9e2b16a078e1f3481ab90fb43.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3b%252F083b580d47362b8ca73cf2e28b4b0644%252Fpa%252FHT75427_011aac957a9cbcb8df2745a6b5916177.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_011aac957a9cbcb8df2745a6b5916177.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3b%252F083b580d47362b8ca73cf2e28b4b0644%252Fpa%252FHT75427_98075ca879a05486b5a7eec9634f9fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_98075ca879a05486b5a7eec9634f9fc7.jpg already downloaded
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F3b%252F083b580d47362b8ca73cf2e28b4b0644%252Fpa%252FHT75427_db336ba3defbabdcb30d773120451ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_db336ba3defbabdcb30d773120451ce3.jpg already downloaded
2026-03-30 07:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a236cd8b-eb03-5d14-8668-a23500f94e05, identifier: HT75427
2026-03-30 07:33:18 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-30 07:33:18 [auto1.de] INFO: Found listing with ID: ZS81921
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS81921%27 HTTP/1.1" 200 None
2026-03-30 07:33:18 [auto1.de] INFO: Scrape type for ZS81921: 2
2026-03-30 07:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with identifier: ZS81921
2026-03-30 07:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with scrape type 2
2026-03-30 07:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with scrape type 2
2026-03-30 07:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14, identifier: ZS81921
2026-03-30 07:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c27bdca-c3fd-5b5b-8214-233b9ec4985a with identifier: MU83144
2026-03-30 07:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c27bdca-c3fd-5b5b-8214-233b9ec4985a with identifier: MU83144
2026-03-30 07:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c27bdca-c3fd-5b5b-8214-233b9ec4985a with identifier: MU83144 to the API
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU83144>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:49:03Z',
 'fuel_type': 'petrol',
 'id': '8c27bdca-c3fd-5b5b-8214-233b9ec4985a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU83144',
 'listing': 'auction',
 'location': 'DE, Montabaur',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 129987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_9e8206c766ce4aecb87c7fad36835512.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_7470eab495da9154043c55908a7ab861.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_eaa3c9edfd616ba5d652763ab073d563.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_750d9365dee3f151e9bcd817f84aea12.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_4c9e5dbc99990907193dce5596090319.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_54cb24a7491ed84fff422618992c70bd.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_2da712b60aad3dc4e2c80085b3d93297.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_e54faea3be3a224a2fe9863a613a91f6.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_89c6cdc6881531ecaecd6f09f46fcbdf.jpg',
                'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_03308c05ae918b8274c93c75c64c789c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_9e8206c766ce4aecb87c7fad36835512.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_7470eab495da9154043c55908a7ab861.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_eaa3c9edfd616ba5d652763ab073d563.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_750d9365dee3f151e9bcd817f84aea12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_4c9e5dbc99990907193dce5596090319.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2263515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_54cb24a7491ed84fff422618992c70bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2037349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_2da712b60aad3dc4e2c80085b3d93297.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_e54faea3be3a224a2fe9863a613a91f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_89c6cdc6881531ecaecd6f09f46fcbdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c27bdca-c3fd-5b5b-8214-233b9ec4985a/8c27bdca-c3fd-5b5b-8214-233b9ec4985a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/56/24560660f8f318471d063070b860c266/pa/MU83144_03308c05ae918b8274c93c75c64c789c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Ambition Plus Edition',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83144%27 HTTP/1.1" 200 None
2026-03-30 07:33:19 [auto1.de] INFO: Saving data for MU83144: {'created_time': 1774855999.415349, 'last_price_update_time': 1774855999.415362, 'auction_closing_time': 1774972143.0}
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU83144') HTTP/1.1" 204 0
2026-03-30 07:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a236cd8b-eb03-5d14-8668-a23500f94e05 with identifier: HT75427
2026-03-30 07:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a236cd8b-eb03-5d14-8668-a23500f94e05 with identifier: HT75427
2026-03-30 07:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a236cd8b-eb03-5d14-8668-a23500f94e05 with identifier: HT75427 to the API
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT75427>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:56:43Z',
 'fuel_type': 'petrol',
 'id': 'a236cd8b-eb03-5d14-8668-a23500f94e05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT75427',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 168136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_fb8505aa7f1ff9219e0fe23af141a05c.jpg',
                'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_4a9119b9e2b16a078e1f3481ab90fb43.jpg',
                'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_011aac957a9cbcb8df2745a6b5916177.jpg',
                'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_98075ca879a05486b5a7eec9634f9fc7.jpg',
                'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_db336ba3defbabdcb30d773120451ce3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a236cd8b-eb03-5d14-8668-a23500f94e05/a236cd8b-eb03-5d14-8668-a23500f94e05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_fb8505aa7f1ff9219e0fe23af141a05c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a236cd8b-eb03-5d14-8668-a23500f94e05/a236cd8b-eb03-5d14-8668-a23500f94e05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_4a9119b9e2b16a078e1f3481ab90fb43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a236cd8b-eb03-5d14-8668-a23500f94e05/a236cd8b-eb03-5d14-8668-a23500f94e05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_011aac957a9cbcb8df2745a6b5916177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a236cd8b-eb03-5d14-8668-a23500f94e05/a236cd8b-eb03-5d14-8668-a23500f94e05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_98075ca879a05486b5a7eec9634f9fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a236cd8b-eb03-5d14-8668-a23500f94e05/a236cd8b-eb03-5d14-8668-a23500f94e05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/3b/083b580d47362b8ca73cf2e28b4b0644/pa/HT75427_db336ba3defbabdcb30d773120451ce3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT75427%27 HTTP/1.1" 200 None
2026-03-30 07:33:19 [auto1.de] INFO: Saving data for HT75427: {'created_time': 1774855999.863542, 'last_price_update_time': 1774855999.863554, 'auction_closing_time': 1774972603.0}
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT75427') HTTP/1.1" 204 0
2026-03-30 07:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with identifier: ZS81921
2026-03-30 07:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with identifier: ZS81921
2026-03-30 07:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14 with identifier: ZS81921 to the API
2026-03-30 07:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:00Z',
 'fuel_type': 'petrol',
 'id': '7fb3c6d0-7fa9-5702-8b29-80a3a0c9cb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS81921',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 158324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Allstar BlueMotion',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion',
 'year': 2017}
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS81921%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Saving data for ZS81921: {'auction_closing_time': 1774969560.0, 'created_time': 1774294746.853905, 'last_price_update_time': 1774856000.222649}
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS81921') HTTP/1.1" 204 0
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_2f652e062aa7738c79ca53e456675451.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_2f652e062aa7738c79ca53e456675451.jpg not downloaded yet
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Scrape type for VS99519: 0
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: ZS81921
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS81921%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Scrape type for ZS81921: 0
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR18351%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Scrape type for YR18351: 2
2026-03-30 07:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351
2026-03-30 07:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3653c0-5213-5c45-aa16-ec2326ace415 with scrape type 2
2026-03-30 07:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f3653c0-5213-5c45-aa16-ec2326ace415 with scrape type 2
2026-03-30 07:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f3653c0-5213-5c45-aa16-ec2326ace415, identifier: YR18351
2026-03-30 07:33:20 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR18351%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Scrape type for YR18351: 2
2026-03-30 07:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3653c0-5213-5c45-aa16-ec2326ace415 with scrape type 2
2026-03-30 07:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f3653c0-5213-5c45-aa16-ec2326ace415 with scrape type 2
2026-03-30 07:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f3653c0-5213-5c45-aa16-ec2326ace415, identifier: YR18351
2026-03-30 07:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351
2026-03-30 07:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351
2026-03-30 07:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351 to the API
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:01:51Z',
 'fuel_type': 'diesel',
 'id': '3f3653c0-5213-5c45-aa16-ec2326ace415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR18351',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 193315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-26',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR18351%27 HTTP/1.1" 200 None
2026-03-30 07:33:20 [auto1.de] INFO: Saving data for YR18351: {'auction_closing_time': 1774969311.0, 'created_time': 1774348300.235208, 'last_price_update_time': 1774856000.863148}
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR18351') HTTP/1.1" 204 0
2026-03-30 07:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW55090> (referer: https://www.auto1.com/v1/car-details-view/AW55090/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc55b050>
2026-03-30 07:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg saved to cache
2026-03-30 07:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351
2026-03-30 07:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351
2026-03-30 07:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f3653c0-5213-5c45-aa16-ec2326ace415 with identifier: YR18351 to the API
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:01:51Z',
 'fuel_type': 'diesel',
 'id': '3f3653c0-5213-5c45-aa16-ec2326ace415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR18351',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 193315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-26',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR18351%27 HTTP/1.1" 200 None
2026-03-30 07:33:21 [auto1.de] INFO: Saving data for YR18351: {'auction_closing_time': 1774969311.0, 'created_time': 1774348300.235208, 'last_price_update_time': 1774856001.315523}
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR18351') HTTP/1.1" 204 0
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg not downloaded yet
2026-03-30 07:33:21 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP99192%27 HTTP/1.1" 200 None
2026-03-30 07:33:21 [auto1.de] INFO: Scrape type for BP99192: 2
2026-03-30 07:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192
2026-03-30 07:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with scrape type 2
2026-03-30 07:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with scrape type 2
2026-03-30 07:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac, identifier: BP99192
2026-03-30 07:33:21 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP99192%27 HTTP/1.1" 200 None
2026-03-30 07:33:21 [auto1.de] INFO: Scrape type for BP99192: 2
2026-03-30 07:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with scrape type 2
2026-03-30 07:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with scrape type 2
2026-03-30 07:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac, identifier: BP99192
2026-03-30 07:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192
2026-03-30 07:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192
2026-03-30 07:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192 to the API
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:12:02Z',
 'fuel_type': 'petrol',
 'id': 'fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP99192',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 69120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2013}
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP99192%27 HTTP/1.1" 200 None
2026-03-30 07:33:21 [auto1.de] INFO: Saving data for BP99192: {'auction_closing_time': 1774969922.0, 'created_time': 1774380239.001045, 'last_price_update_time': 1774856001.914713}
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP99192') HTTP/1.1" 204 0
2026-03-30 07:33:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc847950>
2026-03-30 07:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg saved to cache
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_523b4a80a461e98cae8b0480d2cbace0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192
2026-03-30 07:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192
2026-03-30 07:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac with identifier: BP99192 to the API
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:12:02Z',
 'fuel_type': 'petrol',
 'id': 'fe10c1c5-4f42-5f36-87fb-64bcafa1f6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP99192',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 69120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2013}
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP99192%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [auto1.de] INFO: Saving data for BP99192: {'auction_closing_time': 1774969922.0, 'created_time': 1774380239.001045, 'last_price_update_time': 1774856002.301627}
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP99192') HTTP/1.1" 204 0
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg not downloaded yet
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: TK82535
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: SR73766
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR73766%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [auto1.de] INFO: Scrape type for SR73766: 1
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: TK82535
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: SR73766
2026-03-30 07:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de with identifier: AW55090
2026-03-30 07:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de with scrape type 1
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_10595563f0282a1daaa43699b6f8e86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_10595563f0282a1daaa43699b6f8e86d.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_04159fd6d85af3b355cb4f0280e7b96e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_04159fd6d85af3b355cb4f0280e7b96e.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_c66ea506761b6c6600b803150b02ea80.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_c66ea506761b6c6600b803150b02ea80.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_6fb2187575a1f1e453826f2b8fc67ffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6fb2187575a1f1e453826f2b8fc67ffa.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_fb311fe4db96cadf2450ea1da333f610.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_fb311fe4db96cadf2450ea1da333f610.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_a0681942700fcaaf404536f8653e339c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_a0681942700fcaaf404536f8653e339c.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_599e24a21d0936dfc8aafec148ff1281.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_599e24a21d0936dfc8aafec148ff1281.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_3dc47d2312255a726558f4373c42b834.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3dc47d2312255a726558f4373c42b834.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_6d045643983e7c9e651d2421fbd05d74.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6d045643983e7c9e651d2421fbd05d74.jpg already downloaded
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fb9%252F68b9b2cccd3c6242e2fb897d466c596d%252Fpa%252FAW55090_3f4972846523a8d3d9a71003f6288b91.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3f4972846523a8d3d9a71003f6288b91.jpg already downloaded
2026-03-30 07:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de, identifier: AW55090
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg not downloaded yet
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-30 07:33:22 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-30 07:33:22 [auto1.de] INFO: Scrape type for JD16678: 2
2026-03-30 07:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678
2026-03-30 07:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f82b71-53e4-5e5f-8808-19470f796543 with scrape type 2
2026-03-30 07:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f82b71-53e4-5e5f-8808-19470f796543 with scrape type 2
2026-03-30 07:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47f82b71-53e4-5e5f-8808-19470f796543, identifier: JD16678
2026-03-30 07:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS74444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de with identifier: AW55090
2026-03-30 07:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de with identifier: AW55090
2026-03-30 07:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a02aadb-6e6f-5e4b-9a72-c980ee3f84de with identifier: AW55090 to the API
2026-03-30 07:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW55090>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:44:45Z',
 'fuel_type': 'petrol',
 'id': '4a02aadb-6e6f-5e4b-9a72-c980ee3f84de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW55090',
 'listing': 'auction',
 'location': 'DE, Bensheim',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_10595563f0282a1daaa43699b6f8e86d.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_04159fd6d85af3b355cb4f0280e7b96e.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_c66ea506761b6c6600b803150b02ea80.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6fb2187575a1f1e453826f2b8fc67ffa.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_fb311fe4db96cadf2450ea1da333f610.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_a0681942700fcaaf404536f8653e339c.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_599e24a21d0936dfc8aafec148ff1281.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3dc47d2312255a726558f4373c42b834.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6d045643983e7c9e651d2421fbd05d74.jpg',
                'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3f4972846523a8d3d9a71003f6288b91.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_10595563f0282a1daaa43699b6f8e86d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_04159fd6d85af3b355cb4f0280e7b96e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_c66ea506761b6c6600b803150b02ea80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6fb2187575a1f1e453826f2b8fc67ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_fb311fe4db96cadf2450ea1da333f610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_a0681942700fcaaf404536f8653e339c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_599e24a21d0936dfc8aafec148ff1281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3dc47d2312255a726558f4373c42b834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_6d045643983e7c9e651d2421fbd05d74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a02aadb-6e6f-5e4b-9a72-c980ee3f84de/4a02aadb-6e6f-5e4b-9a72-c980ee3f84de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/b9/68b9b2cccd3c6242e2fb897d466c596d/pa/AW55090_3f4972846523a8d3d9a71003f6288b91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW55090%27 HTTP/1.1" 200 None
2026-03-30 07:33:23 [auto1.de] INFO: Saving data for AW55090: {'created_time': 1774856003.191883, 'last_price_update_time': 1774856003.191894, 'auction_closing_time': 1774971885.0}
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW55090') HTTP/1.1" 204 0
2026-03-30 07:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_491e06050dd9e86432618c8e9d5b6314.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:23 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-30 07:33:23 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-30 07:33:23 [auto1.de] INFO: Scrape type for JD16678: 2
2026-03-30 07:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f82b71-53e4-5e5f-8808-19470f796543 with scrape type 2
2026-03-30 07:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f82b71-53e4-5e5f-8808-19470f796543 with scrape type 2
2026-03-30 07:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47f82b71-53e4-5e5f-8808-19470f796543, identifier: JD16678
2026-03-30 07:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678
2026-03-30 07:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678
2026-03-30 07:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678 to the API
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:11:07Z',
 'fuel_type': 'diesel',
 'id': '47f82b71-53e4-5e5f-8808-19470f796543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD16678',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 196490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-22',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-30 07:33:23 [auto1.de] INFO: Saving data for JD16678: {'auction_closing_time': 1774969867.0, 'created_time': 1774380154.65772, 'last_price_update_time': 1774856003.749203}
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD16678') HTTP/1.1" 204 0
2026-03-30 07:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678
2026-03-30 07:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678
2026-03-30 07:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47f82b71-53e4-5e5f-8808-19470f796543 with identifier: JD16678 to the API
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:11:07Z',
 'fuel_type': 'diesel',
 'id': '47f82b71-53e4-5e5f-8808-19470f796543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD16678',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 196490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-22',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-30 07:33:24 [auto1.de] INFO: Saving data for JD16678: {'auction_closing_time': 1774969867.0, 'created_time': 1774380154.65772, 'last_price_update_time': 1774856004.047286}
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD16678') HTTP/1.1" 204 0
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg not downloaded yet
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: PC52157
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC52157%27 HTTP/1.1" 200 None
2026-03-30 07:33:24 [auto1.de] INFO: Scrape type for PC52157: 1
2026-03-30 07:33:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc42b350>
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_523b4a80a461e98cae8b0480d2cbace0.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_523b4a80a461e98cae8b0480d2cbace0.jpg saved to cache
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: PC52157
2026-03-30 07:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL17171> (referer: https://www.auto1.com/v1/car-details-view/AL17171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: YL08953
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: RS18612
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: AB94973
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB94973%27 HTTP/1.1" 200 None
2026-03-30 07:33:24 [auto1.de] INFO: Scrape type for AB94973: 2
2026-03-30 07:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973
2026-03-30 07:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76630365-67b3-51b2-bbc3-c0baddb8fe2d with scrape type 2
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76630365-67b3-51b2-bbc3-c0baddb8fe2d with scrape type 2
2026-03-30 07:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76630365-67b3-51b2-bbc3-c0baddb8fe2d, identifier: AB94973
2026-03-30 07:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc821710>
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_491e06050dd9e86432618c8e9d5b6314.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_491e06050dd9e86432618c8e9d5b6314.jpg saved to cache
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: YL08953
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: RS18612
2026-03-30 07:33:24 [auto1.de] INFO: Found listing with ID: AB94973
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB94973%27 HTTP/1.1" 200 None
2026-03-30 07:33:24 [auto1.de] INFO: Scrape type for AB94973: 2
2026-03-30 07:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76630365-67b3-51b2-bbc3-c0baddb8fe2d with scrape type 2
2026-03-30 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76630365-67b3-51b2-bbc3-c0baddb8fe2d with scrape type 2
2026-03-30 07:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76630365-67b3-51b2-bbc3-c0baddb8fe2d, identifier: AB94973
2026-03-30 07:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973
2026-03-30 07:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973
2026-03-30 07:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973 to the API
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:28:15Z',
 'fuel_type': 'petrol',
 'id': '76630365-67b3-51b2-bbc3-c0baddb8fe2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB94973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2015}
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB94973%27 HTTP/1.1" 200 None
2026-03-30 07:33:25 [auto1.de] INFO: Saving data for AB94973: {'auction_closing_time': 1774970895.0, 'created_time': 1774290788.430553, 'last_price_update_time': 1774856005.26311}
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB94973') HTTP/1.1" 204 0
2026-03-30 07:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_9a241ad47222949783edcc389dca5080.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0851ef4b984e6b11588caa12b569a9cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973
2026-03-30 07:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973
2026-03-30 07:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76630365-67b3-51b2-bbc3-c0baddb8fe2d with identifier: AB94973 to the API
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:28:15Z',
 'fuel_type': 'petrol',
 'id': '76630365-67b3-51b2-bbc3-c0baddb8fe2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB94973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2015}
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB94973%27 HTTP/1.1" 200 None
2026-03-30 07:33:25 [auto1.de] INFO: Saving data for AB94973: {'auction_closing_time': 1774970895.0, 'created_time': 1774290788.430553, 'last_price_update_time': 1774856005.728172}
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB94973') HTTP/1.1" 204 0
2026-03-30 07:33:25 [auto1.de] INFO: Found listing with ID: VL32137
2026-03-30 07:33:25 [auto1.de] INFO: Found listing with ID: DB97906
2026-03-30 07:33:25 [auto1.de] INFO: Found listing with ID: DZ46114
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ46114%27 HTTP/1.1" 200 None
2026-03-30 07:33:25 [auto1.de] INFO: Scrape type for DZ46114: 2
2026-03-30 07:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041e190f-8308-58f6-bba2-68cedcd395eb with identifier: DZ46114
2026-03-30 07:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041e190f-8308-58f6-bba2-68cedcd395eb with scrape type 2
2026-03-30 07:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 041e190f-8308-58f6-bba2-68cedcd395eb with scrape type 2
2026-03-30 07:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 041e190f-8308-58f6-bba2-68cedcd395eb, identifier: DZ46114
2026-03-30 07:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_c366b46e4072c3241623772b508584b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:25 [auto1.de] INFO: Found listing with ID: VL32137
2026-03-30 07:33:25 [auto1.de] INFO: Found listing with ID: DB97906
2026-03-30 07:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 041e190f-8308-58f6-bba2-68cedcd395eb with identifier: DZ46114
2026-03-30 07:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 041e190f-8308-58f6-bba2-68cedcd395eb with identifier: DZ46114
2026-03-30 07:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 041e190f-8308-58f6-bba2-68cedcd395eb with identifier: DZ46114 to the API
2026-03-30 07:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:59:52Z',
 'fuel_type': 'petrol',
 'id': '041e190f-8308-58f6-bba2-68cedcd395eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ46114',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 57006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST X',
 'transmission': 'manual',
 'trim': 'ST X',
 'year': 2022}
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ46114%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [auto1.de] INFO: Saving data for DZ46114: {'auction_closing_time': 1774972792.0, 'created_time': 1773687572.429407, 'last_price_update_time': 1774856006.362268}
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ46114') HTTP/1.1" 204 0
2026-03-30 07:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7752d0>
2026-03-30 07:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg saved to cache
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f10973-d58c-57f9-874e-db97c32c2541 with identifier: AL17171
2026-03-30 07:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f10973-d58c-57f9-874e-db97c32c2541 with scrape type 1
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92f10973-d58c-57f9-874e-db97c32c2541
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_9e7a39fea4315b95325d2e2b872adaba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_9e7a39fea4315b95325d2e2b872adaba.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_19b88e8d6da0cd1e223b59f1f330a372.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_19b88e8d6da0cd1e223b59f1f330a372.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_09397afbe521b2eb7bb97d3ea16bd0ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_09397afbe521b2eb7bb97d3ea16bd0ca.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_ec3d1ceb97b0525def7e66b7789f0a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_ec3d1ceb97b0525def7e66b7789f0a31.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_89c2d36c74fb17f4f33561373a3d95a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_89c2d36c74fb17f4f33561373a3d95a2.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_f79ed3aea16f607c8dd4c1c327cb16b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f79ed3aea16f607c8dd4c1c327cb16b3.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_827f7919c1fcf0fa27582fe6f55ec28c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_827f7919c1fcf0fa27582fe6f55ec28c.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_a78bfbd27d7a3aa451799602a728a43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_a78bfbd27d7a3aa451799602a728a43a.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_f09bea6e6bae4fa621b48eb83d02883d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f09bea6e6bae4fa621b48eb83d02883d.jpg already downloaded
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F3f%252F473fdda35394f3970a05413e659911d5%252Fpa%252FAL17171_1df2d192548056955850a0b131d6f453.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_1df2d192548056955850a0b131d6f453.jpg already downloaded
2026-03-30 07:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92f10973-d58c-57f9-874e-db97c32c2541, identifier: AL17171
2026-03-30 07:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:26 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-30 07:33:26 [auto1.de] INFO: Found listing with ID: SH12390
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH12390%27 HTTP/1.1" 200 None
2026-03-30 07:33:26 [auto1.de] INFO: Scrape type for SH12390: 2
2026-03-30 07:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783a25f5-1d0c-5103-a032-c6e456f35c84 with identifier: SH12390
2026-03-30 07:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783a25f5-1d0c-5103-a032-c6e456f35c84 with scrape type 2
2026-03-30 07:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 783a25f5-1d0c-5103-a032-c6e456f35c84 with scrape type 2
2026-03-30 07:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 783a25f5-1d0c-5103-a032-c6e456f35c84, identifier: SH12390
2026-03-30 07:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92f10973-d58c-57f9-874e-db97c32c2541 with identifier: AL17171
2026-03-30 07:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92f10973-d58c-57f9-874e-db97c32c2541 with identifier: AL17171
2026-03-30 07:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92f10973-d58c-57f9-874e-db97c32c2541 with identifier: AL17171 to the API
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL17171>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:24:23Z',
 'fuel_type': 'petrol',
 'id': '92f10973-d58c-57f9-874e-db97c32c2541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL17171',
 'listing': 'auction',
 'location': 'DE, Fürstenwalde',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 54885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_9e7a39fea4315b95325d2e2b872adaba.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_19b88e8d6da0cd1e223b59f1f330a372.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_09397afbe521b2eb7bb97d3ea16bd0ca.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_ec3d1ceb97b0525def7e66b7789f0a31.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_89c2d36c74fb17f4f33561373a3d95a2.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f79ed3aea16f607c8dd4c1c327cb16b3.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_827f7919c1fcf0fa27582fe6f55ec28c.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_a78bfbd27d7a3aa451799602a728a43a.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f09bea6e6bae4fa621b48eb83d02883d.jpg',
                'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_1df2d192548056955850a0b131d6f453.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_9e7a39fea4315b95325d2e2b872adaba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_19b88e8d6da0cd1e223b59f1f330a372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_09397afbe521b2eb7bb97d3ea16bd0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_ec3d1ceb97b0525def7e66b7789f0a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_89c2d36c74fb17f4f33561373a3d95a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f79ed3aea16f607c8dd4c1c327cb16b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_827f7919c1fcf0fa27582fe6f55ec28c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_a78bfbd27d7a3aa451799602a728a43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_f09bea6e6bae4fa621b48eb83d02883d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f10973-d58c-57f9-874e-db97c32c2541/92f10973-d58c-57f9-874e-db97c32c2541_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/3f/473fdda35394f3970a05413e659911d5/pa/AL17171_1df2d192548056955850a0b131d6f453.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2020}
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17171%27 HTTP/1.1" 200 None
2026-03-30 07:33:27 [auto1.de] INFO: Saving data for AL17171: {'created_time': 1774856007.272726, 'last_price_update_time': 1774856007.272737, 'auction_closing_time': 1774970663.0}
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL17171') HTTP/1.1" 204 0
2026-03-30 07:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 783a25f5-1d0c-5103-a032-c6e456f35c84 with identifier: SH12390
2026-03-30 07:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 783a25f5-1d0c-5103-a032-c6e456f35c84 with identifier: SH12390
2026-03-30 07:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 783a25f5-1d0c-5103-a032-c6e456f35c84 with identifier: SH12390 to the API
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:57:52Z',
 'fuel_type': 'diesel',
 'id': '783a25f5-1d0c-5103-a032-c6e456f35c84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH12390',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 220552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-08',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH12390%27 HTTP/1.1" 200 None
2026-03-30 07:33:27 [auto1.de] INFO: Saving data for SH12390: {'auction_closing_time': 1774972672.0, 'created_time': 1773688402.504921, 'last_price_update_time': 1774856007.648473}
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH12390') HTTP/1.1" 204 0
2026-03-30 07:33:27 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 7375 | hits on page: 40
2026-03-30 07:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c6090>
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg saved to cache
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6858d0>
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_9a241ad47222949783edcc389dca5080.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_9a241ad47222949783edcc389dca5080.jpg saved to cache
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca59b90>
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_0851ef4b984e6b11588caa12b569a9cc.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0851ef4b984e6b11588caa12b569a9cc.jpg saved to cache
2026-03-30 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:27 [auto1.de] INFO: Found listing with ID: ED21052
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED21052%27 HTTP/1.1" 200 None
2026-03-30 07:33:27 [auto1.de] INFO: Scrape type for ED21052: 1
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8f6390>
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_c366b46e4072c3241623772b508584b8.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_c366b46e4072c3241623772b508584b8.jpg saved to cache
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: JF05487
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: XE53561
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-30 07:33:28 [auto1.de] INFO: Scrape type for VC14600: 2
2026-03-30 07:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600
2026-03-30 07:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de5ab89-2344-54d1-8d9f-7fd007d21509 with scrape type 2
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de5ab89-2344-54d1-8d9f-7fd007d21509 with scrape type 2
2026-03-30 07:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de5ab89-2344-54d1-8d9f-7fd007d21509, identifier: VC14600
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: KB70594
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: JF05487
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: XE53561
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 07:33:28 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-30 07:33:28 [auto1.de] INFO: Scrape type for VC14600: 2
2026-03-30 07:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de5ab89-2344-54d1-8d9f-7fd007d21509 with scrape type 2
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de5ab89-2344-54d1-8d9f-7fd007d21509 with scrape type 2
2026-03-30 07:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de5ab89-2344-54d1-8d9f-7fd007d21509, identifier: VC14600
2026-03-30 07:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600
2026-03-30 07:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600
2026-03-30 07:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600 to the API
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:43Z',
 'fuel_type': 'diesel',
 'id': '9de5ab89-2344-54d1-8d9f-7fd007d21509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC14600',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 205517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-30 07:33:28 [auto1.de] INFO: Saving data for VC14600: {'auction_closing_time': 1774970323.0, 'created_time': 1774378490.410786, 'last_price_update_time': 1774856008.609535}
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC14600') HTTP/1.1" 204 0
2026-03-30 07:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR73766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6d0710>
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg saved to cache
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bebe8450>
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg saved to cache
2026-03-30 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600
2026-03-30 07:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600
2026-03-30 07:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de5ab89-2344-54d1-8d9f-7fd007d21509 with identifier: VC14600 to the API
2026-03-30 07:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:43Z',
 'fuel_type': 'diesel',
 'id': '9de5ab89-2344-54d1-8d9f-7fd007d21509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC14600',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 205517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-30 07:33:29 [auto1.de] INFO: Saving data for VC14600: {'auction_closing_time': 1774970323.0, 'created_time': 1774378490.410786, 'last_price_update_time': 1774856009.158523}
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC14600') HTTP/1.1" 204 0
2026-03-30 07:33:29 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN27989%27 HTTP/1.1" 200 None
2026-03-30 07:33:29 [auto1.de] INFO: Scrape type for EN27989: 2
2026-03-30 07:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989
2026-03-30 07:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462b7cca-8d85-546e-b99e-8cd3f6551843 with scrape type 2
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462b7cca-8d85-546e-b99e-8cd3f6551843 with scrape type 2
2026-03-30 07:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462b7cca-8d85-546e-b99e-8cd3f6551843, identifier: EN27989
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:29 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN27989%27 HTTP/1.1" 200 None
2026-03-30 07:33:29 [auto1.de] INFO: Scrape type for EN27989: 2
2026-03-30 07:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462b7cca-8d85-546e-b99e-8cd3f6551843 with scrape type 2
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462b7cca-8d85-546e-b99e-8cd3f6551843 with scrape type 2
2026-03-30 07:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462b7cca-8d85-546e-b99e-8cd3f6551843, identifier: EN27989
2026-03-30 07:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989
2026-03-30 07:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989
2026-03-30 07:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989 to the API
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'petrol',
 'id': '462b7cca-8d85-546e-b99e-8cd3f6551843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN27989',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 62779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN27989%27 HTTP/1.1" 200 None
2026-03-30 07:33:29 [auto1.de] INFO: Saving data for EN27989: {'auction_closing_time': 1774970608.0, 'created_time': 1773773691.726482, 'last_price_update_time': 1774856009.890209}
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN27989') HTTP/1.1" 204 0
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc8920d0>
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg saved to cache
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc72d410>
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg saved to cache
2026-03-30 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989
2026-03-30 07:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989
2026-03-30 07:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462b7cca-8d85-546e-b99e-8cd3f6551843 with identifier: EN27989 to the API
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'petrol',
 'id': '462b7cca-8d85-546e-b99e-8cd3f6551843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN27989',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 62779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN27989%27 HTTP/1.1" 200 None
2026-03-30 07:33:30 [auto1.de] INFO: Saving data for EN27989: {'auction_closing_time': 1774970608.0, 'created_time': 1773773691.726482, 'last_price_update_time': 1774856010.298967}
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN27989') HTTP/1.1" 204 0
2026-03-30 07:33:30 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-30 07:33:30 [auto1.de] INFO: Scrape type for BP13198: 2
2026-03-30 07:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198
2026-03-30 07:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with scrape type 2
2026-03-30 07:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with scrape type 2
2026-03-30 07:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98ca3c9c-cd16-58e5-bad6-6039f7e02839, identifier: BP13198
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ00196> (referer: https://www.auto1.com/v1/car-details-view/HJ00196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:30 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-30 07:33:30 [auto1.de] INFO: Scrape type for BP13198: 2
2026-03-30 07:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with scrape type 2
2026-03-30 07:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with scrape type 2
2026-03-30 07:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98ca3c9c-cd16-58e5-bad6-6039f7e02839, identifier: BP13198
2026-03-30 07:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198
2026-03-30 07:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198
2026-03-30 07:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198 to the API
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:40:50Z',
 'fuel_type': 'petrol',
 'id': '98ca3c9c-cd16-58e5-bad6-6039f7e02839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP13198',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 159781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-30 07:33:30 [auto1.de] INFO: Saving data for BP13198: {'auction_closing_time': 1774971650.0, 'created_time': 1773137446.871498, 'last_price_update_time': 1774856010.887299}
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP13198') HTTP/1.1" 204 0
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_e53da30a39d27d2efa90c31457200b6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_2f652e062aa7738c79ca53e456675451.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198
2026-03-30 07:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198
2026-03-30 07:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98ca3c9c-cd16-58e5-bad6-6039f7e02839 with identifier: BP13198 to the API
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:40:50Z',
 'fuel_type': 'petrol',
 'id': '98ca3c9c-cd16-58e5-bad6-6039f7e02839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP13198',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 159781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-30 07:33:31 [auto1.de] INFO: Saving data for BP13198: {'auction_closing_time': 1774971650.0, 'created_time': 1773137446.871498, 'last_price_update_time': 1774856011.582336}
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP13198') HTTP/1.1" 204 0
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80786%27 HTTP/1.1" 200 None
2026-03-30 07:33:31 [auto1.de] INFO: Scrape type for JB80786: 2
2026-03-30 07:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786
2026-03-30 07:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75eed19-a294-5099-8466-dea98ac1ee73 with scrape type 2
2026-03-30 07:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c75eed19-a294-5099-8466-dea98ac1ee73 with scrape type 2
2026-03-30 07:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c75eed19-a294-5099-8466-dea98ac1ee73, identifier: JB80786
2026-03-30 07:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 07:33:31 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80786%27 HTTP/1.1" 200 None
2026-03-30 07:33:31 [auto1.de] INFO: Scrape type for JB80786: 2
2026-03-30 07:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75eed19-a294-5099-8466-dea98ac1ee73 with scrape type 2
2026-03-30 07:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c75eed19-a294-5099-8466-dea98ac1ee73 with scrape type 2
2026-03-30 07:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c75eed19-a294-5099-8466-dea98ac1ee73, identifier: JB80786
2026-03-30 07:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786
2026-03-30 07:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786
2026-03-30 07:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786 to the API
2026-03-30 07:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-31T15:12:23Z',
 'fuel_type': 'diesel',
 'id': 'c75eed19-a294-5099-8466-dea98ac1ee73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB80786',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 93216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Audi A8 3.0 TDI Mild-Hybrid 50 quattro',
 'transmission': 'automatic',
 'trim': '50 quattro',
 'year': 2019}
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80786%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [auto1.de] INFO: Saving data for JB80786: {'auction_closing_time': 1774969943.0, 'created_time': 1774435225.420285, 'last_price_update_time': 1774856012.195157}
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB80786') HTTP/1.1" 204 0
2026-03-30 07:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786
2026-03-30 07:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786
2026-03-30 07:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c75eed19-a294-5099-8466-dea98ac1ee73 with identifier: JB80786 to the API
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-31T15:12:23Z',
 'fuel_type': 'diesel',
 'id': 'c75eed19-a294-5099-8466-dea98ac1ee73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB80786',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 93216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Audi A8 3.0 TDI Mild-Hybrid 50 quattro',
 'transmission': 'automatic',
 'trim': '50 quattro',
 'year': 2019}
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80786%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [auto1.de] INFO: Saving data for JB80786: {'auction_closing_time': 1774969943.0, 'created_time': 1774435225.420285, 'last_price_update_time': 1774856012.485919}
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB80786') HTTP/1.1" 204 0
2026-03-30 07:33:32 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ09553%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [auto1.de] INFO: Scrape type for MJ09553: 1
2026-03-30 07:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be with identifier: HJ00196
2026-03-30 07:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be with scrape type 1
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_5dd848f98c9f509adbfab9dc3586446b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_5dd848f98c9f509adbfab9dc3586446b.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_47cec947c314a2dcb5ea140e8660a1ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_47cec947c314a2dcb5ea140e8660a1ef.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_6be736ffea130f3b75ce6702325f3adc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_6be736ffea130f3b75ce6702325f3adc.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_8b752d134e18601af61ce6efde4219d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8b752d134e18601af61ce6efde4219d1.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_4f215d7ed164e30263cc4dc3a0a96b84.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_4f215d7ed164e30263cc4dc3a0a96b84.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_fdb3285314e8e4bb7472e6d6375fd496.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fdb3285314e8e4bb7472e6d6375fd496.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_8bf2c3d964d633500fabec36372fb9ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8bf2c3d964d633500fabec36372fb9ba.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_fa9014ef4343ef1fedaf099bfab19298.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fa9014ef4343ef1fedaf099bfab19298.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_55e03c62b9bcd247cde0a487b4630801.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_55e03c62b9bcd247cde0a487b4630801.jpg already downloaded
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F11%252F2911e2f4caa1136474761ebef2129503%252Fpa%252FHJ00196_edda1b7e386c74e3fe93622ca1e7f0d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_edda1b7e386c74e3fe93622ca1e7f0d4.jpg already downloaded
2026-03-30 07:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be, identifier: HJ00196
2026-03-30 07:33:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc89ef10>
2026-03-30 07:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg saved to cache
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:33 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 07:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be with identifier: HJ00196
2026-03-30 07:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be with identifier: HJ00196
2026-03-30 07:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60dd0fc9-76f7-59c3-a5be-d0aa5c5483be with identifier: HJ00196 to the API
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HJ00196>
{'auction_title': '',
 'c_o_2_emission_value': 251,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 199,
 'expiration_date': '2026-03-31T15:03:40Z',
 'fuel_type': 'diesel',
 'id': '60dd0fc9-76f7-59c3-a5be-d0aa5c5483be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ00196',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 117242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_5dd848f98c9f509adbfab9dc3586446b.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_47cec947c314a2dcb5ea140e8660a1ef.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_6be736ffea130f3b75ce6702325f3adc.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8b752d134e18601af61ce6efde4219d1.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_4f215d7ed164e30263cc4dc3a0a96b84.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fdb3285314e8e4bb7472e6d6375fd496.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8bf2c3d964d633500fabec36372fb9ba.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fa9014ef4343ef1fedaf099bfab19298.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_55e03c62b9bcd247cde0a487b4630801.jpg',
                'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_edda1b7e386c74e3fe93622ca1e7f0d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3138164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_5dd848f98c9f509adbfab9dc3586446b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_47cec947c314a2dcb5ea140e8660a1ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_6be736ffea130f3b75ce6702325f3adc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8b752d134e18601af61ce6efde4219d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_4f215d7ed164e30263cc4dc3a0a96b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fdb3285314e8e4bb7472e6d6375fd496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_8bf2c3d964d633500fabec36372fb9ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_fa9014ef4343ef1fedaf099bfab19298.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_55e03c62b9bcd247cde0a487b4630801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60dd0fc9-76f7-59c3-a5be-d0aa5c5483be/60dd0fc9-76f7-59c3-a5be-d0aa5c5483be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/11/2911e2f4caa1136474761ebef2129503/pa/HJ00196_edda1b7e386c74e3fe93622ca1e7f0d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2019}
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ00196%27 HTTP/1.1" 200 None
2026-03-30 07:33:33 [auto1.de] INFO: Saving data for HJ00196: {'created_time': 1774856013.464042, 'last_price_update_time': 1774856013.464053, 'auction_closing_time': 1774969420.0}
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ00196') HTTP/1.1" 204 0
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beb14c90>
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_e53da30a39d27d2efa90c31457200b6e.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_e53da30a39d27d2efa90c31457200b6e.jpg saved to cache
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca51a50>
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg saved to cache
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc519ad0>
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_2f652e062aa7738c79ca53e456675451.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_2f652e062aa7738c79ca53e456675451.jpg saved to cache
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc686590>
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105bc7bae2310bc08f64de0f1bbab57%252Fpa%252FEW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg saved to cache
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16a41573-6bec-5ab4-9703-82d3a220d5b0
2026-03-30 07:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16a41573-6bec-5ab4-9703-82d3a220d5b0, skipping ID generation
2026-03-30 07:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a41573-6bec-5ab4-9703-82d3a220d5b0 with scrape type 1
2026-03-30 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16a41573-6bec-5ab4-9703-82d3a220d5b0 sending to next pipeline
2026-03-30 07:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a41573-6bec-5ab4-9703-82d3a220d5b0, identifier: EW76258
2026-03-30 07:33:33 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA13261%27 HTTP/1.1" 200 None
2026-03-30 07:33:33 [auto1.de] INFO: Scrape type for JA13261: 1
2026-03-30 07:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a41573-6bec-5ab4-9703-82d3a220d5b0 with identifier: EW76258
2026-03-30 07:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a41573-6bec-5ab4-9703-82d3a220d5b0 with identifier: EW76258
2026-03-30 07:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a41573-6bec-5ab4-9703-82d3a220d5b0 with identifier: EW76258 to the API
2026-03-30 07:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:26:01Z',
 'fuel_type': 'diesel',
 'id': '16a41573-6bec-5ab4-9703-82d3a220d5b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW76258',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 175635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54523,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_491e06050dd9e86432618c8e9d5b6314.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57078,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0851ef4b984e6b11588caa12b569a9cc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52873,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_e53da30a39d27d2efa90c31457200b6e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48043,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_c366b46e4072c3241623772b508584b8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44680,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_fe02a41fd441e6eecf8ada96613b46f9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55032,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_2f652e062aa7738c79ca53e456675451.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46424,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_8b438ca14a8aae42354c20ed1fc70e3c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55485,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_ee4fbad4a4733870f2628b68cf3ddfa9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50769,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_a8bea5324f9ae7e1cb41e877d3c96001.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a41573-6bec-5ab4-9703-82d3a220d5b0/16a41573-6bec-5ab4-9703-82d3a220d5b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57322,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105bc7bae2310bc08f64de0f1bbab57/pa/EW76258_0da0bb67c08fb4fdddbbf7c913915867.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Diesel Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76258%27 HTTP/1.1" 200 None
2026-03-30 07:33:34 [auto1.de] INFO: Saving data for EW76258: {'created_time': 1774856014.277589, 'last_price_update_time': 1774856014.277601, 'auction_closing_time': 1774970761.0}
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW76258') HTTP/1.1" 204 0
2026-03-30 07:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_0c24a502f50906c136cb85ba906e5515.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 07:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc4ef050>
2026-03-30 07:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F38%252Ff23881e585f42944d68d6b437b64b428%252Fpa%252FME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg saved to cache
2026-03-30 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede
2026-03-30 07:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede, skipping ID generation
2026-03-30 07:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with scrape type 1
2026-03-30 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede sending to next pipeline
2026-03-30 07:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede, identifier: ME76972
2026-03-30 07:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: SY32033
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: FY66164
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: FG89265
2026-03-30 07:33:34 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ23402%27 HTTP/1.1" 200 None
2026-03-30 07:33:34 [auto1.de] INFO: Scrape type for NJ23402: 2
2026-03-30 07:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with identifier: NJ23402
2026-03-30 07:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with scrape type 2
2026-03-30 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with scrape type 2
2026-03-30 07:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6, identifier: NJ23402
2026-03-30 07:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with identifier: ME76972
2026-03-30 07:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with identifier: ME76972
2026-03-30 07:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 375639a3-bc6f-55bc-a5b0-4c5efc8c4ede with identifier: ME76972 to the API
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 293,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '4.4L',
 'engine_horse_power': 315,
 'expiration_date': '2026-03-31T15:19:12Z',
 'fuel_type': 'petrol',
 'id': '375639a3-bc6f-55bc-a5b0-4c5efc8c4ede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME76972',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 117788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_067dda4ab1ae3674af9f79df33cd7b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_0117aab3ed258883e5a4e3b866cfad5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d9bed550f3a61e42be79e36fce70300d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_eebe54a91fc5ce9bcf7446aaf7f22e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_160c5d1e329e04f75f9732e36ee69e72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_5bf85c698770bcf6a4374df8c6937665.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_d4473c0c60c0e9e24cef6f4003886c45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2ff030d313412bc545d7935378ba6c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_2c0ccba4c506c8bea5c8291705371248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375639a3-bc6f-55bc-a5b0-4c5efc8c4ede/375639a3-bc6f-55bc-a5b0-4c5efc8c4ede_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/38/f23881e585f42944d68d6b437b64b428/pa/ME76972_fc9ab316dc71f25f587801f4353365d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S80 4.4 V8 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2006}
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME76972%27 HTTP/1.1" 200 None
2026-03-30 07:33:34 [auto1.de] INFO: Saving data for ME76972: {'created_time': 1774856014.993566, 'last_price_update_time': 1774856014.993578, 'auction_closing_time': 1774970352.0}
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME76972') HTTP/1.1" 204 0
2026-03-30 07:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with identifier: NJ23402
2026-03-30 07:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with identifier: NJ23402
2026-03-30 07:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6 with identifier: NJ23402 to the API
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:52:37Z',
 'fuel_type': 'petrol',
 'id': 'b1ab2d8b-e4eb-5de0-88a8-05a13696dfd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ23402',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 155075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ23402%27 HTTP/1.1" 200 None
2026-03-30 07:33:35 [auto1.de] INFO: Saving data for NJ23402: {'auction_closing_time': 1774972357.0, 'created_time': 1774349328.935547, 'last_price_update_time': 1774856015.344264}
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ23402') HTTP/1.1" 204 0
2026-03-30 07:33:35 [auto1.de] INFO: Found listing with ID: VM87282
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM87282%27 HTTP/1.1" 200 None
2026-03-30 07:33:35 [auto1.de] INFO: Scrape type for VM87282: 2
2026-03-30 07:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85273683-30af-54f3-8d8d-b00f90582b87 with identifier: VM87282
2026-03-30 07:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85273683-30af-54f3-8d8d-b00f90582b87 with scrape type 2
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85273683-30af-54f3-8d8d-b00f90582b87 with scrape type 2
2026-03-30 07:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85273683-30af-54f3-8d8d-b00f90582b87, identifier: VM87282
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7c4790>
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_0c24a502f50906c136cb85ba906e5515.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_0c24a502f50906c136cb85ba906e5515.jpg saved to cache
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be7db610>
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg saved to cache
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc48dd10>
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg saved to cache
2026-03-30 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85273683-30af-54f3-8d8d-b00f90582b87 with identifier: VM87282
2026-03-30 07:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85273683-30af-54f3-8d8d-b00f90582b87 with identifier: VM87282
2026-03-30 07:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85273683-30af-54f3-8d8d-b00f90582b87 with identifier: VM87282 to the API
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:01:05Z',
 'fuel_type': 'diesel',
 'id': '85273683-30af-54f3-8d8d-b00f90582b87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM87282',
 'listing': 'auction',
 'make': 'Isuzu',
 'model': 'D-MAX',
 'odometer': 207470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-21',
 'seller_name': None,
 'title': 'Isuzu D-MAX 2.5 Twin Turbodiesel Single Cab Basis 4WD',
 'transmission': 'manual',
 'trim': 'Single Cab Basis 4WD',
 'year': 2014}
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM87282%27 HTTP/1.1" 200 None
2026-03-30 07:33:35 [auto1.de] INFO: Saving data for VM87282: {'auction_closing_time': 1774969265.0, 'created_time': 1773136899.542028, 'last_price_update_time': 1774856015.970185}
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM87282') HTTP/1.1" 204 0
2026-03-30 07:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: SJ00642
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ00642%27 HTTP/1.1" 200 None
2026-03-30 07:33:36 [auto1.de] INFO: Scrape type for SJ00642: 1
2026-03-30 07:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6b9150>
2026-03-30 07:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg saved to cache
2026-03-30 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: KP36820
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: GH85781
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH85781%27 HTTP/1.1" 200 None
2026-03-30 07:33:36 [auto1.de] INFO: Scrape type for GH85781: 2
2026-03-30 07:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97715b0b-043f-5435-a1d5-65916fb22e11 with identifier: GH85781
2026-03-30 07:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97715b0b-043f-5435-a1d5-65916fb22e11 with scrape type 2
2026-03-30 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97715b0b-043f-5435-a1d5-65916fb22e11 with scrape type 2
2026-03-30 07:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97715b0b-043f-5435-a1d5-65916fb22e11, identifier: GH85781
2026-03-30 07:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97715b0b-043f-5435-a1d5-65916fb22e11 with identifier: GH85781
2026-03-30 07:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97715b0b-043f-5435-a1d5-65916fb22e11 with identifier: GH85781
2026-03-30 07:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97715b0b-043f-5435-a1d5-65916fb22e11 with identifier: GH85781 to the API
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:17:13Z',
 'fuel_type': 'petrol',
 'id': '97715b0b-043f-5435-a1d5-65916fb22e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH85781',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 107984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH85781%27 HTTP/1.1" 200 None
2026-03-30 07:33:36 [auto1.de] INFO: Saving data for GH85781: {'auction_closing_time': 1774970233.0, 'created_time': 1774291890.189176, 'last_price_update_time': 1774856016.500167}
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH85781') HTTP/1.1" 204 0
2026-03-30 07:33:36 [auto1.de] INFO: Found listing with ID: LV95619
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV95619%27 HTTP/1.1" 200 None
2026-03-30 07:33:36 [auto1.de] INFO: Scrape type for LV95619: 2
2026-03-30 07:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a05937e-45ce-5767-a84d-7aa5f3566b4d with identifier: LV95619
2026-03-30 07:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a05937e-45ce-5767-a84d-7aa5f3566b4d with scrape type 2
2026-03-30 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a05937e-45ce-5767-a84d-7aa5f3566b4d with scrape type 2
2026-03-30 07:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a05937e-45ce-5767-a84d-7aa5f3566b4d, identifier: LV95619
2026-03-30 07:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a05937e-45ce-5767-a84d-7aa5f3566b4d with identifier: LV95619
2026-03-30 07:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a05937e-45ce-5767-a84d-7aa5f3566b4d with identifier: LV95619
2026-03-30 07:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a05937e-45ce-5767-a84d-7aa5f3566b4d with identifier: LV95619 to the API
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:34:03Z',
 'fuel_type': 'petrol',
 'id': '7a05937e-45ce-5767-a84d-7aa5f3566b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV95619',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 42815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV95619%27 HTTP/1.1" 200 None
2026-03-30 07:33:37 [auto1.de] INFO: Saving data for LV95619: {'auction_closing_time': 1774971243.0, 'created_time': 1774294212.544153, 'last_price_update_time': 1774856017.073962}
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV95619') HTTP/1.1" 204 0
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3e4a10>
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg saved to cache
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: HT22196
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22196%27 HTTP/1.1" 200 None
2026-03-30 07:33:37 [auto1.de] INFO: Scrape type for HT22196: 1
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED21052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY47476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV80430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC52157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS74444> (referer: https://www.auto1.com/v1/car-details-view/ZS74444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX93212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: XY36888
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: ZS85717
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY75346%27 HTTP/1.1" 200 None
2026-03-30 07:33:37 [auto1.de] INFO: Scrape type for BY75346: 2
2026-03-30 07:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13b7462f-5dcb-5698-90bf-af2b4210b707 with identifier: BY75346
2026-03-30 07:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13b7462f-5dcb-5698-90bf-af2b4210b707 with scrape type 2
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13b7462f-5dcb-5698-90bf-af2b4210b707 with scrape type 2
2026-03-30 07:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13b7462f-5dcb-5698-90bf-af2b4210b707, identifier: BY75346
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13b7462f-5dcb-5698-90bf-af2b4210b707 with identifier: BY75346
2026-03-30 07:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13b7462f-5dcb-5698-90bf-af2b4210b707 with identifier: BY75346
2026-03-30 07:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13b7462f-5dcb-5698-90bf-af2b4210b707 with identifier: BY75346 to the API
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:22:21Z',
 'fuel_type': 'petrol',
 'id': '13b7462f-5dcb-5698-90bf-af2b4210b707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY75346',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 133945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-30',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY75346%27 HTTP/1.1" 200 None
2026-03-30 07:33:37 [auto1.de] INFO: Saving data for BY75346: {'auction_closing_time': 1774970541.0, 'created_time': 1773304449.474732, 'last_price_update_time': 1774856017.668896}
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY75346') HTTP/1.1" 204 0
2026-03-30 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_915acfcca34f94c35a372dd52933b959.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:37 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-30 07:33:37 [auto1.de] INFO: Scrape type for CC27418: 2
2026-03-30 07:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0067d524-95a8-57fd-bc19-e74d290d1146 with identifier: CC27418
2026-03-30 07:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0067d524-95a8-57fd-bc19-e74d290d1146 with scrape type 2
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0067d524-95a8-57fd-bc19-e74d290d1146 with scrape type 2
2026-03-30 07:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0067d524-95a8-57fd-bc19-e74d290d1146, identifier: CC27418
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc5792d0>
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fc6%252F1dc6f728609e6a6fb399a7dd61b8ada7%252Fpa%252FLZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg saved to cache
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75901884-51d6-58a5-9a15-c69fdbfca97f
2026-03-30 07:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75901884-51d6-58a5-9a15-c69fdbfca97f, skipping ID generation
2026-03-30 07:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75901884-51d6-58a5-9a15-c69fdbfca97f with scrape type 1
2026-03-30 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75901884-51d6-58a5-9a15-c69fdbfca97f sending to next pipeline
2026-03-30 07:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75901884-51d6-58a5-9a15-c69fdbfca97f, identifier: LZ55907
2026-03-30 07:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0067d524-95a8-57fd-bc19-e74d290d1146 with identifier: CC27418
2026-03-30 07:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0067d524-95a8-57fd-bc19-e74d290d1146 with identifier: CC27418
2026-03-30 07:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0067d524-95a8-57fd-bc19-e74d290d1146 with identifier: CC27418 to the API
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:48:43Z',
 'fuel_type': 'petrol',
 'id': '0067d524-95a8-57fd-bc19-e74d290d1146',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC27418',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 110851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2017}
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [auto1.de] INFO: Saving data for CC27418: {'auction_closing_time': 1774972123.0, 'created_time': 1773917079.990925, 'last_price_update_time': 1774856018.296745}
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC27418') HTTP/1.1" 204 0
2026-03-30 07:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR73766> (referer: https://www.auto1.com/v1/car-details-view/SR73766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75901884-51d6-58a5-9a15-c69fdbfca97f with identifier: LZ55907
2026-03-30 07:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75901884-51d6-58a5-9a15-c69fdbfca97f with identifier: LZ55907
2026-03-30 07:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75901884-51d6-58a5-9a15-c69fdbfca97f with identifier: LZ55907 to the API
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:46:50Z',
 'fuel_type': 'electro',
 'id': '75901884-51d6-58a5-9a15-c69fdbfca97f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ55907',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 56,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_30a990b0cd536a2bdf33e8263c690f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_f1cce71adad76b974dcfdd6d27716c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_c453da77cc4f6a44ceac6cbca9773e34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_0c79d4708e4dc7d58ea43b34f52890dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_27d5c7006f4281f04644136ca7805daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_a5c51d7b2d88313907edd2523fd887f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_aceba79d0a68ac40b44fa45eba8b6c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_7e6c59fb84658f62be1bd7c41902f640.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_312a267b2465ac2f80d9fbae0485c049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75901884-51d6-58a5-9a15-c69fdbfca97f/75901884-51d6-58a5-9a15-c69fdbfca97f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/c6/1dc6f728609e6a6fb399a7dd61b8ada7/pa/LZ55907_af69ad73a1a23d1d1ec2ce0e0437c582.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ55907%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [auto1.de] INFO: Saving data for LZ55907: {'created_time': 1774856018.707982, 'last_price_update_time': 1774856018.707995, 'auction_closing_time': 1774972010.0}
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ55907') HTTP/1.1" 204 0
2026-03-30 07:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_71ab669e06ff9516418094d11856be56.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:38 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT72839%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [auto1.de] INFO: Scrape type for HT72839: 1
2026-03-30 07:33:38 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 7397 | hits on page: 40
2026-03-30 07:33:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca80cd0>
2026-03-30 07:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg saved to cache
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea5f5a2-5751-516b-9873-821ac8f8c65e with identifier: ZS74444
2026-03-30 07:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea5f5a2-5751-516b-9873-821ac8f8c65e with scrape type 1
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ea5f5a2-5751-516b-9873-821ac8f8c65e
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_8f9a284043ba20386f2cea1ad83ed764.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_8f9a284043ba20386f2cea1ad83ed764.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_f4264461eb92be04b0a7a4de09edf9c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_f4264461eb92be04b0a7a4de09edf9c0.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_e37891442c3a796fcf96e475c14d96be.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_e37891442c3a796fcf96e475c14d96be.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_dc6cab06edb8b76dd33db04a2c4e5567.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_dc6cab06edb8b76dd33db04a2c4e5567.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_2a56fb3f4001d2d880fab98892f3809e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2a56fb3f4001d2d880fab98892f3809e.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_0835b571af01806bd2a3f8b636ca4735.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_0835b571af01806bd2a3f8b636ca4735.jpg already downloaded
2026-03-30 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_2d22b41f2a28ff65748cd10b5a4b66a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2d22b41f2a28ff65748cd10b5a4b66a4.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_1b8bea056b6ad26b51009c9941e34686.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_1b8bea056b6ad26b51009c9941e34686.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_00721c66bf347332f059915a843635d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_00721c66bf347332f059915a843635d0.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F55%252F27557e69b700538bcb1b9bf001e5c6c0%252Fpa%252FZS74444_168a7295dc09d7d9e5d0393b73f78158.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_168a7295dc09d7d9e5d0393b73f78158.jpg already downloaded
2026-03-30 07:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ea5f5a2-5751-516b-9873-821ac8f8c65e, identifier: ZS74444
2026-03-30 07:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ea5f5a2-5751-516b-9873-821ac8f8c65e with identifier: ZS74444
2026-03-30 07:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ea5f5a2-5751-516b-9873-821ac8f8c65e with identifier: ZS74444
2026-03-30 07:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ea5f5a2-5751-516b-9873-821ac8f8c65e with identifier: ZS74444 to the API
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS74444>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:07:24Z',
 'fuel_type': 'petrol',
 'id': '0ea5f5a2-5751-516b-9873-821ac8f8c65e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS74444',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 142572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_8f9a284043ba20386f2cea1ad83ed764.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_f4264461eb92be04b0a7a4de09edf9c0.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_e37891442c3a796fcf96e475c14d96be.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_dc6cab06edb8b76dd33db04a2c4e5567.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2a56fb3f4001d2d880fab98892f3809e.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_0835b571af01806bd2a3f8b636ca4735.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2d22b41f2a28ff65748cd10b5a4b66a4.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_1b8bea056b6ad26b51009c9941e34686.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_00721c66bf347332f059915a843635d0.jpg',
                'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_168a7295dc09d7d9e5d0393b73f78158.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_8f9a284043ba20386f2cea1ad83ed764.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_f4264461eb92be04b0a7a4de09edf9c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_e37891442c3a796fcf96e475c14d96be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2092505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_dc6cab06edb8b76dd33db04a2c4e5567.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2a56fb3f4001d2d880fab98892f3809e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_0835b571af01806bd2a3f8b636ca4735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_2d22b41f2a28ff65748cd10b5a4b66a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_1b8bea056b6ad26b51009c9941e34686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_00721c66bf347332f059915a843635d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ea5f5a2-5751-516b-9873-821ac8f8c65e/0ea5f5a2-5751-516b-9873-821ac8f8c65e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/55/27557e69b700538bcb1b9bf001e5c6c0/pa/ZS74444_168a7295dc09d7d9e5d0393b73f78158.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 My Doblo',
 'transmission': 'manual',
 'trim': 'My',
 'year': 2013}
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS74444%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [auto1.de] INFO: Saving data for ZS74444: {'created_time': 1774856019.485223, 'last_price_update_time': 1774856019.485234, 'auction_closing_time': 1774969644.0}
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS74444') HTTP/1.1" 204 0
2026-03-30 07:33:39 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 07:33:39 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 07:33:39 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 07:33:39 [auto1.de] INFO: Found listing with ID: DF54938
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF54938%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [auto1.de] INFO: Scrape type for DF54938: 1
2026-03-30 07:33:39 [auto1.de] INFO: Found listing with ID: SJ00642
2026-03-30 07:33:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71be9873d0>
2026-03-30 07:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F34%252Ff9343bd276becd8190250c008f41836f%252Fpa%252FVG83409_915acfcca34f94c35a372dd52933b959.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_915acfcca34f94c35a372dd52933b959.jpg saved to cache
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edf06035-5673-5d24-ab1e-cebafc5ae28a
2026-03-30 07:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edf06035-5673-5d24-ab1e-cebafc5ae28a, skipping ID generation
2026-03-30 07:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf06035-5673-5d24-ab1e-cebafc5ae28a with scrape type 1
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edf06035-5673-5d24-ab1e-cebafc5ae28a sending to next pipeline
2026-03-30 07:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edf06035-5673-5d24-ab1e-cebafc5ae28a, identifier: VG83409
2026-03-30 07:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7052491a-5c7c-54cb-9602-9421e33f6de3 with identifier: SR73766
2026-03-30 07:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7052491a-5c7c-54cb-9602-9421e33f6de3 with scrape type 1
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7052491a-5c7c-54cb-9602-9421e33f6de3
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_fbf82e111f0fbec6b8a26eacd0dfe65a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_fbf82e111f0fbec6b8a26eacd0dfe65a.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_115928e03bbceea0582c1f9f678e8015.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_115928e03bbceea0582c1f9f678e8015.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_6898df690b67ded89292f4709f4e6538.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_6898df690b67ded89292f4709f4e6538.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_04727f5afa72bd970c6adc7b2b6bdcce.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_04727f5afa72bd970c6adc7b2b6bdcce.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_e8926471d501598ab0806b00864b8ccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_e8926471d501598ab0806b00864b8ccf.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_aea5e15b0b11158a6dcb3f06482c5b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_aea5e15b0b11158a6dcb3f06482c5b4e.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_46036dcab034b61ea97d7b25e16fe172.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_46036dcab034b61ea97d7b25e16fe172.jpg already downloaded
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_dd6ac4d0cb9d9a466dfd36b40b61a31d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_dd6ac4d0cb9d9a466dfd36b40b61a31d.jpg already downloaded
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_11e7914c23efd9e825cbca7b9ba051ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_11e7914c23efd9e825cbca7b9ba051ec.jpg already downloaded
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F03%252Fe60353cc2a01e830e14c543600928e7d%252Fpa%252FSR73766_3ecd5ec2a4602f55d9568b9c92be5261.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_3ecd5ec2a4602f55d9568b9c92be5261.jpg already downloaded
2026-03-30 07:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7052491a-5c7c-54cb-9602-9421e33f6de3, identifier: SR73766
2026-03-30 07:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edf06035-5673-5d24-ab1e-cebafc5ae28a with identifier: VG83409
2026-03-30 07:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edf06035-5673-5d24-ab1e-cebafc5ae28a with identifier: VG83409
2026-03-30 07:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edf06035-5673-5d24-ab1e-cebafc5ae28a with identifier: VG83409 to the API
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_915acfcca34f94c35a372dd52933b959.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:16:21Z',
 'fuel_type': 'diesel',
 'id': 'edf06035-5673-5d24-ab1e-cebafc5ae28a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG83409',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 139976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_cad1db60ae17a8a90baa0f426fc7dfbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_e33d01586cf7f4ef8e2d465f31c6913d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796973,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_523b4a80a461e98cae8b0480d2cbace0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_915acfcca34f94c35a372dd52933b959.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_f08bdb07ca7b80bd2140c7ae98bc5990.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_c541c986cc12254e6dfb4a52bf7c1335.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_9a241ad47222949783edcc389dca5080.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_77191f6b26f0a489ff69a6758a0dbfe2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_6200826b9d3885f7d38f2ffb887ae60b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf06035-5673-5d24-ab1e-cebafc5ae28a/edf06035-5673-5d24-ab1e-cebafc5ae28a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/34/f9343bd276becd8190250c008f41836f/pa/VG83409_92e5ae9aefc5d4a44695cc8c973e7c81.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG83409%27 HTTP/1.1" 200 None
2026-03-30 07:33:40 [auto1.de] INFO: Saving data for VG83409: {'created_time': 1774856020.542633, 'last_price_update_time': 1774856020.542645, 'auction_closing_time': 1774970181.0}
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG83409') HTTP/1.1" 204 0
2026-03-30 07:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7052491a-5c7c-54cb-9602-9421e33f6de3 with identifier: SR73766
2026-03-30 07:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7052491a-5c7c-54cb-9602-9421e33f6de3 with identifier: SR73766
2026-03-30 07:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7052491a-5c7c-54cb-9602-9421e33f6de3 with identifier: SR73766 to the API
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR73766>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:48Z',
 'fuel_type': 'petrol',
 'id': '7052491a-5c7c-54cb-9602-9421e33f6de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR73766',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 199544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_fbf82e111f0fbec6b8a26eacd0dfe65a.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_115928e03bbceea0582c1f9f678e8015.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_6898df690b67ded89292f4709f4e6538.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_04727f5afa72bd970c6adc7b2b6bdcce.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_e8926471d501598ab0806b00864b8ccf.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_aea5e15b0b11158a6dcb3f06482c5b4e.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_46036dcab034b61ea97d7b25e16fe172.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_dd6ac4d0cb9d9a466dfd36b40b61a31d.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_11e7914c23efd9e825cbca7b9ba051ec.jpg',
                'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_3ecd5ec2a4602f55d9568b9c92be5261.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_fbf82e111f0fbec6b8a26eacd0dfe65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_115928e03bbceea0582c1f9f678e8015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_6898df690b67ded89292f4709f4e6538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_04727f5afa72bd970c6adc7b2b6bdcce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_e8926471d501598ab0806b00864b8ccf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_aea5e15b0b11158a6dcb3f06482c5b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_46036dcab034b61ea97d7b25e16fe172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_dd6ac4d0cb9d9a466dfd36b40b61a31d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_11e7914c23efd9e825cbca7b9ba051ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7052491a-5c7c-54cb-9602-9421e33f6de3/7052491a-5c7c-54cb-9602-9421e33f6de3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/03/e60353cc2a01e830e14c543600928e7d/pa/SR73766_3ecd5ec2a4602f55d9568b9c92be5261.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR73766%27 HTTP/1.1" 200 None
2026-03-30 07:33:40 [auto1.de] INFO: Saving data for SR73766: {'created_time': 1774856020.949122, 'last_price_update_time': 1774856020.949134, 'auction_closing_time': 1774969908.0}
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR73766') HTTP/1.1" 204 0
2026-03-30 07:33:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: KP36820
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: GH85781
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH85781%27 HTTP/1.1" 200 None
2026-03-30 07:33:40 [auto1.de] INFO: Scrape type for GH85781: 0
2026-03-30 07:33:40 [auto1.de] INFO: Found listing with ID: LV95619
2026-03-30 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV95619%27 HTTP/1.1" 200 None
2026-03-30 07:33:41 [auto1.de] INFO: Scrape type for LV95619: 0
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: HT22196
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ00642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3dc350>
2026-03-30 07:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F90%252F3e909c3438b1702b534c76287369ac5d%252Fpa%252FXV83798_71ab669e06ff9516418094d11856be56.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_71ab669e06ff9516418094d11856be56.jpg saved to cache
2026-03-30 07:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2aa5302d-eb86-52c8-9444-f02387afe39e
2026-03-30 07:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2aa5302d-eb86-52c8-9444-f02387afe39e, skipping ID generation
2026-03-30 07:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa5302d-eb86-52c8-9444-f02387afe39e with scrape type 1
2026-03-30 07:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2aa5302d-eb86-52c8-9444-f02387afe39e sending to next pipeline
2026-03-30 07:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aa5302d-eb86-52c8-9444-f02387afe39e, identifier: XV83798
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: XY36888
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: ZS85717
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY75346%27 HTTP/1.1" 200 None
2026-03-30 07:33:41 [auto1.de] INFO: Scrape type for BY75346: 0
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-30 07:33:41 [auto1.de] INFO: Scrape type for CC27418: 0
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ09553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM89162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA13261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX71728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD26673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aa5302d-eb86-52c8-9444-f02387afe39e with identifier: XV83798
2026-03-30 07:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aa5302d-eb86-52c8-9444-f02387afe39e with identifier: XV83798
2026-03-30 07:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aa5302d-eb86-52c8-9444-f02387afe39e with identifier: XV83798 to the API
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_71ab669e06ff9516418094d11856be56.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:11:05Z',
 'fuel_type': 'petrol',
 'id': '2aa5302d-eb86-52c8-9444-f02387afe39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV83798',
 'listing': 'auction',
 'location': 'DE, Schwäbisch Hall',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 89146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_71ab669e06ff9516418094d11856be56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_f5188d9e628b12615961fcdcf5eb3ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_0c24a502f50906c136cb85ba906e5515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_31c93f4bb7196ef0b5c8d01a8a7b9174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_197790e78c95084fd7e6c4d74e59eae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa5302d-eb86-52c8-9444-f02387afe39e/2aa5302d-eb86-52c8-9444-f02387afe39e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/90/3e909c3438b1702b534c76287369ac5d/pa/XV83798_83069744caa99b952f566cbc4aca2e32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2011}
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83798%27 HTTP/1.1" 200 None
2026-03-30 07:33:41 [auto1.de] INFO: Saving data for XV83798: {'created_time': 1774856021.599589, 'last_price_update_time': 1774856021.5996, 'auction_closing_time': 1774969865.0}
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV83798') HTTP/1.1" 204 0
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT22196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: DF54938
2026-03-30 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: KU11171
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: MP54327
2026-03-30 07:33:41 [auto1.de] INFO: Found listing with ID: KG86059
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG86059%27 HTTP/1.1" 200 None
2026-03-30 07:33:41 [auto1.de] INFO: Scrape type for KG86059: 2
2026-03-30 07:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with identifier: KG86059
2026-03-30 07:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with scrape type 2
2026-03-30 07:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with scrape type 2
2026-03-30 07:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd, identifier: KG86059
2026-03-30 07:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with identifier: KG86059
2026-03-30 07:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with identifier: KG86059
2026-03-30 07:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd with identifier: KG86059 to the API
2026-03-30 07:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:58Z',
 'fuel_type': 'diesel',
 'id': 'ffbf46a0-8f4e-5939-b47b-0a8c814c7ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG86059',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 260566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG86059%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Saving data for KG86059: {'auction_closing_time': 1774970638.0, 'created_time': 1773660163.783826, 'last_price_update_time': 1774856022.236473}
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG86059') HTTP/1.1" 204 0
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: FZ65862
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ65862%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Scrape type for FZ65862: 2
2026-03-30 07:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-03-30 07:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with scrape type 2
2026-03-30 07:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with scrape type 2
2026-03-30 07:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e, identifier: FZ65862
2026-03-30 07:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-03-30 07:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862
2026-03-30 07:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e with identifier: FZ65862 to the API
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:31:32Z',
 'fuel_type': 'petrol',
 'id': 'e8453d4d-fdaf-5614-8d8d-0eee6d09ff8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ65862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 159731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 300 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ65862%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Saving data for FZ65862: {'auction_closing_time': 1774971092.0, 'created_time': 1774263321.995726, 'last_price_update_time': 1774856022.700621}
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ65862') HTTP/1.1" 204 0
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: XU97028
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU97028%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Scrape type for XU97028: 1
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: TG66732
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: KX83375
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: DM93215
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM93215%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Scrape type for DM93215: 1
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: EK40849
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: PU51927
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: PL78548
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: FD53596
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: RD37486
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 07:33:42 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20909%27 HTTP/1.1" 200 None
2026-03-30 07:33:42 [auto1.de] INFO: Scrape type for PX20909: 2
2026-03-30 07:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5321d1-660b-5077-bfad-75c03ec6869b with identifier: PX20909
2026-03-30 07:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5321d1-660b-5077-bfad-75c03ec6869b with scrape type 2
2026-03-30 07:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b5321d1-660b-5077-bfad-75c03ec6869b with scrape type 2
2026-03-30 07:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b5321d1-660b-5077-bfad-75c03ec6869b, identifier: PX20909
2026-03-30 07:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b5321d1-660b-5077-bfad-75c03ec6869b with identifier: PX20909
2026-03-30 07:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b5321d1-660b-5077-bfad-75c03ec6869b with identifier: PX20909
2026-03-30 07:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b5321d1-660b-5077-bfad-75c03ec6869b with identifier: PX20909 to the API
2026-03-30 07:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:34:15Z',
 'fuel_type': 'hybrid',
 'id': '6b5321d1-660b-5077-bfad-75c03ec6869b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX20909',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 43793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Bastille+',
 'transmission': 'automatic',
 'trim': '4x2 Bastille+',
 'year': 2022}
2026-03-30 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20909%27 HTTP/1.1" 200 None
2026-03-30 07:33:43 [auto1.de] INFO: Saving data for PX20909: {'auction_closing_time': 1774971255.0, 'created_time': 1773307078.997966, 'last_price_update_time': 1774856023.233541}
2026-03-30 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX20909') HTTP/1.1" 204 0
2026-03-30 07:33:43 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 07:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF54938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC52157> (referer: https://www.auto1.com/v1/car-details-view/PC52157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV80430> (referer: https://www.auto1.com/v1/car-details-view/AV80430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT72839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b362ddb9-830c-5be4-8554-2f9cf899c949 with identifier: PC52157
2026-03-30 07:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b362ddb9-830c-5be4-8554-2f9cf899c949 with scrape type 1
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b362ddb9-830c-5be4-8554-2f9cf899c949
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_e0f796c56f995504b54421145647ce36.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_e0f796c56f995504b54421145647ce36.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_5972d448de8f89f791341dc54ec15b8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5972d448de8f89f791341dc54ec15b8f.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_1219db40af5f0143ddf02ca51a0a5374.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_1219db40af5f0143ddf02ca51a0a5374.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_6bfa5c19069b8e843b76c167f569aa8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_6bfa5c19069b8e843b76c167f569aa8d.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_5a65a1a992faaf5811f9ec5607e69a4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5a65a1a992faaf5811f9ec5607e69a4e.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_c25de586c50b4f447405f2a414cab692.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_c25de586c50b4f447405f2a414cab692.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_bb46667ec249d9b601d9b02cbcd7daee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_bb46667ec249d9b601d9b02cbcd7daee.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_175ed0ab0ca5ec9160b0ddcd79534552.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_175ed0ab0ca5ec9160b0ddcd79534552.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_a192dd951100086c2f0f3f3767112c2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_a192dd951100086c2f0f3f3767112c2e.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fd6%252F82d6d57af8af02cfbd870dae8d0f8ea6%252Fpa%252FPC52157_30afa757b19f29e20df0ac12d67159b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_30afa757b19f29e20df0ac12d67159b9.jpg already downloaded
2026-03-30 07:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b362ddb9-830c-5be4-8554-2f9cf899c949, identifier: PC52157
2026-03-30 07:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b362ddb9-830c-5be4-8554-2f9cf899c949 with identifier: PC52157
2026-03-30 07:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b362ddb9-830c-5be4-8554-2f9cf899c949 with identifier: PC52157
2026-03-30 07:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b362ddb9-830c-5be4-8554-2f9cf899c949 with identifier: PC52157 to the API
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC52157>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:49Z',
 'fuel_type': 'diesel',
 'id': 'b362ddb9-830c-5be4-8554-2f9cf899c949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC52157',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 80130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_e0f796c56f995504b54421145647ce36.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5972d448de8f89f791341dc54ec15b8f.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_1219db40af5f0143ddf02ca51a0a5374.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_6bfa5c19069b8e843b76c167f569aa8d.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5a65a1a992faaf5811f9ec5607e69a4e.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_c25de586c50b4f447405f2a414cab692.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_bb46667ec249d9b601d9b02cbcd7daee.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_175ed0ab0ca5ec9160b0ddcd79534552.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_a192dd951100086c2f0f3f3767112c2e.jpg',
                'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_30afa757b19f29e20df0ac12d67159b9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_e0f796c56f995504b54421145647ce36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5972d448de8f89f791341dc54ec15b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_1219db40af5f0143ddf02ca51a0a5374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_6bfa5c19069b8e843b76c167f569aa8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_5a65a1a992faaf5811f9ec5607e69a4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_c25de586c50b4f447405f2a414cab692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3501083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_bb46667ec249d9b601d9b02cbcd7daee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_175ed0ab0ca5ec9160b0ddcd79534552.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_a192dd951100086c2f0f3f3767112c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b362ddb9-830c-5be4-8554-2f9cf899c949/b362ddb9-830c-5be4-8554-2f9cf899c949_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/d6/82d6d57af8af02cfbd870dae8d0f8ea6/pa/PC52157_30afa757b19f29e20df0ac12d67159b9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC52157%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [auto1.de] INFO: Saving data for PC52157: {'created_time': 1774856024.925085, 'last_price_update_time': 1774856024.925097, 'auction_closing_time': 1774969309.0}
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC52157') HTTP/1.1" 204 0
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED21052> (referer: https://www.auto1.com/v1/car-details-view/ED21052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY47476> (referer: https://www.auto1.com/v1/car-details-view/SY47476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ00642> (referer: https://www.auto1.com/v1/car-details-view/SJ00642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:44 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 7414 | hits on page: 40
2026-03-30 07:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a73286-bdf6-5c00-acba-e00a95a1bf0d with identifier: AV80430
2026-03-30 07:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a73286-bdf6-5c00-acba-e00a95a1bf0d with scrape type 1
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00a73286-bdf6-5c00-acba-e00a95a1bf0d
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_0e12b3729c35014880ff58b122119abf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_0e12b3729c35014880ff58b122119abf.jpg already downloaded
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_a9f73aced435fa71d26246ef938d6c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a9f73aced435fa71d26246ef938d6c2b.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_6ff5924754eb63197473ee9cafb55be7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_6ff5924754eb63197473ee9cafb55be7.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_418da7cf3663aeea1261e6b924b3a86b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_418da7cf3663aeea1261e6b924b3a86b.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_3f978043f8d890040ed4e6d91a871e84.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_3f978043f8d890040ed4e6d91a871e84.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_12f1b930077b389ddbd6a3e6b45adb12.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_12f1b930077b389ddbd6a3e6b45adb12.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_a189bb64a4689fe34312db9eb8e4159c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a189bb64a4689fe34312db9eb8e4159c.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_b14c1a361eeaa2fb85cb956bbc0c8260.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_b14c1a361eeaa2fb85cb956bbc0c8260.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_fc8e9fd2e6d3d0e6c834c6c9f3bd07cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_fc8e9fd2e6d3d0e6c834c6c9f3bd07cd.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F2a%252Fd42a7f9d69590cf0715c4c73078d8272%252Fpa%252FAV80430_45840d21636da29a021550c3063deed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_45840d21636da29a021550c3063deed7.jpg already downloaded
2026-03-30 07:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00a73286-bdf6-5c00-acba-e00a95a1bf0d, identifier: AV80430
2026-03-30 07:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00a73286-bdf6-5c00-acba-e00a95a1bf0d with identifier: AV80430
2026-03-30 07:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00a73286-bdf6-5c00-acba-e00a95a1bf0d with identifier: AV80430
2026-03-30 07:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00a73286-bdf6-5c00-acba-e00a95a1bf0d with identifier: AV80430 to the API
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV80430>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:35:36Z',
 'fuel_type': 'diesel',
 'id': '00a73286-bdf6-5c00-acba-e00a95a1bf0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV80430',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 204258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_0e12b3729c35014880ff58b122119abf.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a9f73aced435fa71d26246ef938d6c2b.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_6ff5924754eb63197473ee9cafb55be7.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_418da7cf3663aeea1261e6b924b3a86b.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_3f978043f8d890040ed4e6d91a871e84.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_12f1b930077b389ddbd6a3e6b45adb12.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a189bb64a4689fe34312db9eb8e4159c.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_b14c1a361eeaa2fb85cb956bbc0c8260.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_fc8e9fd2e6d3d0e6c834c6c9f3bd07cd.jpg',
                'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_45840d21636da29a021550c3063deed7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 16214,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_0e12b3729c35014880ff58b122119abf.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 16214,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a9f73aced435fa71d26246ef938d6c2b.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31679,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_6ff5924754eb63197473ee9cafb55be7.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13381,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_418da7cf3663aeea1261e6b924b3a86b.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 15451,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_3f978043f8d890040ed4e6d91a871e84.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 17590,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_12f1b930077b389ddbd6a3e6b45adb12.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 12354,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_a189bb64a4689fe34312db9eb8e4159c.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 17043,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_b14c1a361eeaa2fb85cb956bbc0c8260.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_fc8e9fd2e6d3d0e6c834c6c9f3bd07cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00a73286-bdf6-5c00-acba-e00a95a1bf0d/00a73286-bdf6-5c00-acba-e00a95a1bf0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 15451,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/2a/d42a7f9d69590cf0715c4c73078d8272/pa/AV80430_45840d21636da29a021550c3063deed7.jpg',
             'Width': 340}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 350 EL Trend LKW',
 'transmission': 'manual',
 'trim': 'FT 350 EL Trend LKW',
 'year': 2014}
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV80430%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [auto1.de] INFO: Saving data for AV80430: {'created_time': 1774856025.664737, 'last_price_update_time': 1774856025.664749, 'auction_closing_time': 1774971336.0}
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV80430') HTTP/1.1" 204 0
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: MP54327
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: KG86059
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG86059%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [auto1.de] INFO: Scrape type for KG86059: 0
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: FZ65862
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ65862%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [auto1.de] INFO: Scrape type for FZ65862: 0
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: XU97028
2026-03-30 07:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX93212> (referer: https://www.auto1.com/v1/car-details-view/HX93212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: TG66732
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: KX83375
2026-03-30 07:33:45 [auto1.de] INFO: Found listing with ID: DM93215
2026-03-30 07:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb05b0f-1e08-5afd-b277-02dfb5559b71 with identifier: ED21052
2026-03-30 07:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb05b0f-1e08-5afd-b277-02dfb5559b71 with scrape type 1
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfb05b0f-1e08-5afd-b277-02dfb5559b71
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_bf19b9c0b63822fe31cf06509afffc94.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_bf19b9c0b63822fe31cf06509afffc94.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_f285ee6cac42e391f0f0efe25fbaa787.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_f285ee6cac42e391f0f0efe25fbaa787.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_6e238edebdf5551ae9cf2643f0094dbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_6e238edebdf5551ae9cf2643f0094dbb.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_cdf9d3bdfccd3e5f77779a8f65bcc488.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_cdf9d3bdfccd3e5f77779a8f65bcc488.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_d8c3a1def901b4b0913b8f0899ccb533.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d8c3a1def901b4b0913b8f0899ccb533.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_69f762456ecbb83fb166ae0eaa5955a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_69f762456ecbb83fb166ae0eaa5955a4.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_d5cb0701db647c53162e66a36e4ce7cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d5cb0701db647c53162e66a36e4ce7cd.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_35a1fb6955b25211540b38ab03eb0c5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_35a1fb6955b25211540b38ab03eb0c5d.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_66f211da39a72a2ae05f2451cac27ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_66f211da39a72a2ae05f2451cac27ed1.jpg already downloaded
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F8c%252F388c8be6f49556cd95400106fded24ac%252Fpa%252FED21052_7cb0aaaab678ab036100192d815afc5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_7cb0aaaab678ab036100192d815afc5f.jpg already downloaded
2026-03-30 07:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfb05b0f-1e08-5afd-b277-02dfb5559b71, identifier: ED21052
2026-03-30 07:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 353be830-822c-54c9-944b-63226c8166e0 with identifier: SY47476
2026-03-30 07:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 353be830-822c-54c9-944b-63226c8166e0 with scrape type 1
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 353be830-822c-54c9-944b-63226c8166e0
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_70df1349c048e811d64c6d578279cbf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_70df1349c048e811d64c6d578279cbf3.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_8ad331c12a008d0ef4bcf8eb4052f0e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_8ad331c12a008d0ef4bcf8eb4052f0e3.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_c8746e2758dda936d1255d2f63e46d6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_c8746e2758dda936d1255d2f63e46d6a.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_52e5972d07312a7b6fc44f979f3f849a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_52e5972d07312a7b6fc44f979f3f849a.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_747a4a5b683f26d3a9bb82e4010b58a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_747a4a5b683f26d3a9bb82e4010b58a8.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_b50511d6313e728a0a12d678e3d9e482.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_b50511d6313e728a0a12d678e3d9e482.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_9cc74cab93bed1d284c524d237e000a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_9cc74cab93bed1d284c524d237e000a1.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_6366ecd8a24723400e0469d54360077b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_6366ecd8a24723400e0469d54360077b.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_cb4dfb73d52fb4f51d7daf84c097c950.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_cb4dfb73d52fb4f51d7daf84c097c950.jpg already downloaded
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc4%252F89c4b0e0ad33879696f876618b4f23e3%252Fpa%252FSY47476_384f6b8310ad8ffe79a673181d57253e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_384f6b8310ad8ffe79a673181d57253e.jpg already downloaded
2026-03-30 07:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 353be830-822c-54c9-944b-63226c8166e0, identifier: SY47476
2026-03-30 07:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with identifier: SJ00642
2026-03-30 07:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with scrape type 1
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg not downloaded yet
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: EK40849
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: PU51927
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: PL78548
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: FD53596
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: RD37486
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20909%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [auto1.de] INFO: Scrape type for PX20909: 0
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: CC87438
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-30 07:33:46 [auto1.de] INFO: Found listing with ID: WM40779
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM40779%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [auto1.de] INFO: Scrape type for WM40779: 1
2026-03-30 07:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfb05b0f-1e08-5afd-b277-02dfb5559b71 with identifier: ED21052
2026-03-30 07:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfb05b0f-1e08-5afd-b277-02dfb5559b71 with identifier: ED21052
2026-03-30 07:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfb05b0f-1e08-5afd-b277-02dfb5559b71 with identifier: ED21052 to the API
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED21052>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:07Z',
 'fuel_type': 'diesel',
 'id': 'cfb05b0f-1e08-5afd-b277-02dfb5559b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED21052',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 142079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_bf19b9c0b63822fe31cf06509afffc94.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_f285ee6cac42e391f0f0efe25fbaa787.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_6e238edebdf5551ae9cf2643f0094dbb.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_cdf9d3bdfccd3e5f77779a8f65bcc488.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d8c3a1def901b4b0913b8f0899ccb533.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_69f762456ecbb83fb166ae0eaa5955a4.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d5cb0701db647c53162e66a36e4ce7cd.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_35a1fb6955b25211540b38ab03eb0c5d.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_66f211da39a72a2ae05f2451cac27ed1.jpg',
                'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_7cb0aaaab678ab036100192d815afc5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_bf19b9c0b63822fe31cf06509afffc94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_f285ee6cac42e391f0f0efe25fbaa787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_6e238edebdf5551ae9cf2643f0094dbb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_cdf9d3bdfccd3e5f77779a8f65bcc488.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d8c3a1def901b4b0913b8f0899ccb533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_69f762456ecbb83fb166ae0eaa5955a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_d5cb0701db647c53162e66a36e4ce7cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_35a1fb6955b25211540b38ab03eb0c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_66f211da39a72a2ae05f2451cac27ed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb05b0f-1e08-5afd-b277-02dfb5559b71/cfb05b0f-1e08-5afd-b277-02dfb5559b71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/8c/388c8be6f49556cd95400106fded24ac/pa/ED21052_7cb0aaaab678ab036100192d815afc5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2016}
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED21052%27 HTTP/1.1" 200 None
2026-03-30 07:33:46 [auto1.de] INFO: Saving data for ED21052: {'created_time': 1774856026.859881, 'last_price_update_time': 1774856026.859893, 'auction_closing_time': 1774970227.0}
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED21052') HTTP/1.1" 204 0
2026-03-30 07:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 353be830-822c-54c9-944b-63226c8166e0 with identifier: SY47476
2026-03-30 07:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 353be830-822c-54c9-944b-63226c8166e0 with identifier: SY47476
2026-03-30 07:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 353be830-822c-54c9-944b-63226c8166e0 with identifier: SY47476 to the API
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY47476>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'petrol',
 'id': '353be830-822c-54c9-944b-63226c8166e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY47476',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 52216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_70df1349c048e811d64c6d578279cbf3.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_8ad331c12a008d0ef4bcf8eb4052f0e3.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_c8746e2758dda936d1255d2f63e46d6a.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_52e5972d07312a7b6fc44f979f3f849a.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_747a4a5b683f26d3a9bb82e4010b58a8.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_b50511d6313e728a0a12d678e3d9e482.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_9cc74cab93bed1d284c524d237e000a1.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_6366ecd8a24723400e0469d54360077b.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_cb4dfb73d52fb4f51d7daf84c097c950.jpg',
                'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_384f6b8310ad8ffe79a673181d57253e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_70df1349c048e811d64c6d578279cbf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_8ad331c12a008d0ef4bcf8eb4052f0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_c8746e2758dda936d1255d2f63e46d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_52e5972d07312a7b6fc44f979f3f849a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_747a4a5b683f26d3a9bb82e4010b58a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_b50511d6313e728a0a12d678e3d9e482.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_9cc74cab93bed1d284c524d237e000a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_6366ecd8a24723400e0469d54360077b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_cb4dfb73d52fb4f51d7daf84c097c950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_353be830-822c-54c9-944b-63226c8166e0/353be830-822c-54c9-944b-63226c8166e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/c4/89c4b0e0ad33879696f876618b4f23e3/pa/SY47476_384f6b8310ad8ffe79a673181d57253e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47476%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [auto1.de] INFO: Saving data for SY47476: {'created_time': 1774856027.300758, 'last_price_update_time': 1774856027.300771, 'auction_closing_time': 1774972683.0}
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY47476') HTTP/1.1" 204 0
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_50ded59ce0893df09ed90648addfe27c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_50ded59ce0893df09ed90648addfe27c.jpg not downloaded yet
2026-03-30 07:33:47 [auto1.de] INFO: Found listing with ID: CJ14168
2026-03-30 07:33:47 [auto1.de] INFO: Found listing with ID: FR51775
2026-03-30 07:33:47 [auto1.de] INFO: Found listing with ID: VP95743
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95743%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [auto1.de] INFO: Scrape type for VP95743: 1
2026-03-30 07:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc with identifier: HX93212
2026-03-30 07:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc with scrape type 1
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_7fdb880adf22cb89fe387c366b5c1d4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_7fdb880adf22cb89fe387c366b5c1d4b.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_575cbcece259e82722629842b96e07d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_575cbcece259e82722629842b96e07d1.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_5e19971cdf408def44b92e6d4596722c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_5e19971cdf408def44b92e6d4596722c.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_95fe6cb718de5ae384e857f7b097fa74.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_95fe6cb718de5ae384e857f7b097fa74.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_09931c5a99ab9641191a837f2f897981.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_09931c5a99ab9641191a837f2f897981.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_d6cfdb28ce706269cca42e1c73c30ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_d6cfdb28ce706269cca42e1c73c30ff2.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_896a4fe0dd653f1c75b5bbf302209ad7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_896a4fe0dd653f1c75b5bbf302209ad7.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_cb8a85206724acdb4a43792dd390646c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_cb8a85206724acdb4a43792dd390646c.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_460724b315f0ce6685db433f976af4c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_460724b315f0ce6685db433f976af4c9.jpg already downloaded
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fde%252Fbcde6df3d175d34093574f175b3d382a%252Fpa%252FHX93212_72602544fcdfaa0ece0e6061ecb4f7f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_72602544fcdfaa0ece0e6061ecb4f7f9.jpg already downloaded
2026-03-30 07:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc, identifier: HX93212
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg not downloaded yet
2026-03-30 07:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD26673> (referer: https://www.auto1.com/v1/car-details-view/GD26673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA13261> (referer: https://www.auto1.com/v1/car-details-view/JA13261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM89162> (referer: https://www.auto1.com/v1/car-details-view/ZM89162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX71728> (referer: https://www.auto1.com/v1/car-details-view/ZX71728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc with identifier: HX93212
2026-03-30 07:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc with identifier: HX93212
2026-03-30 07:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc with identifier: HX93212 to the API
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX93212>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:01Z',
 'fuel_type': 'diesel',
 'id': 'e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX93212',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 180657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_7fdb880adf22cb89fe387c366b5c1d4b.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_575cbcece259e82722629842b96e07d1.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_5e19971cdf408def44b92e6d4596722c.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_95fe6cb718de5ae384e857f7b097fa74.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_09931c5a99ab9641191a837f2f897981.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_d6cfdb28ce706269cca42e1c73c30ff2.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_896a4fe0dd653f1c75b5bbf302209ad7.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_cb8a85206724acdb4a43792dd390646c.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_460724b315f0ce6685db433f976af4c9.jpg',
                'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_72602544fcdfaa0ece0e6061ecb4f7f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_7fdb880adf22cb89fe387c366b5c1d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_575cbcece259e82722629842b96e07d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_5e19971cdf408def44b92e6d4596722c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_95fe6cb718de5ae384e857f7b097fa74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_09931c5a99ab9641191a837f2f897981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_d6cfdb28ce706269cca42e1c73c30ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_896a4fe0dd653f1c75b5bbf302209ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_cb8a85206724acdb4a43792dd390646c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_460724b315f0ce6685db433f976af4c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc/e6cb092b-85ec-57b1-a0ac-2ad4c26d66fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/de/bcde6df3d175d34093574f175b3d382a/pa/HX93212_72602544fcdfaa0ece0e6061ecb4f7f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX93212%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [auto1.de] INFO: Saving data for HX93212: {'created_time': 1774856028.073452, 'last_price_update_time': 1774856028.073463, 'auction_closing_time': 1774969621.0}
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX93212') HTTP/1.1" 204 0
2026-03-30 07:33:48 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-30 07:33:48 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 07:33:48 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY77324%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [auto1.de] INFO: Scrape type for CY77324: 1
2026-03-30 07:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg not downloaded yet
2026-03-30 07:33:48 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 07:33:48 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP46159%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [auto1.de] INFO: Scrape type for KP46159: 2
2026-03-30 07:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 020cd00d-99cc-540f-b54a-b9bb8689ece6 with identifier: KP46159
2026-03-30 07:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 020cd00d-99cc-540f-b54a-b9bb8689ece6 with scrape type 2
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 020cd00d-99cc-540f-b54a-b9bb8689ece6 with scrape type 2
2026-03-30 07:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 020cd00d-99cc-540f-b54a-b9bb8689ece6, identifier: KP46159
2026-03-30 07:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19aa357-eae3-591a-8104-2455ec206d6a with identifier: GD26673
2026-03-30 07:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19aa357-eae3-591a-8104-2455ec206d6a with scrape type 1
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e19aa357-eae3-591a-8104-2455ec206d6a
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_5e0b8465d93ac9557af8ac399ae7124a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5e0b8465d93ac9557af8ac399ae7124a.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_2946abe6fb431f2eb4d06b9138211707.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2946abe6fb431f2eb4d06b9138211707.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_a01f621ae6f9067eacba64874eeae379.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_a01f621ae6f9067eacba64874eeae379.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_f2311fce808b6fa295c220f8480003da.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_f2311fce808b6fa295c220f8480003da.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_1d193ffee96bc4cd9087d3047f334caf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_1d193ffee96bc4cd9087d3047f334caf.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_34a7929a02bffd3e7a5e632a87894cf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_34a7929a02bffd3e7a5e632a87894cf9.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_5be85b9c2ed42a3f54230a520ec03c44.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5be85b9c2ed42a3f54230a520ec03c44.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_c0d893d28187ea34166430a58ba36cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_c0d893d28187ea34166430a58ba36cb8.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_68d40445c5145b801119e624f31d9ab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_68d40445c5145b801119e624f31d9ab6.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fee%252Fc2ee273803c17d5faa6dc0bdf1f0a895%252Fpa%252FGD26673_2584c1c52c7a0cb0a91fe308797eedfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2584c1c52c7a0cb0a91fe308797eedfd.jpg already downloaded
2026-03-30 07:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e19aa357-eae3-591a-8104-2455ec206d6a, identifier: GD26673
2026-03-30 07:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59e9c4c-9bb3-542f-b2aa-d51d8059cef0 with identifier: JA13261
2026-03-30 07:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59e9c4c-9bb3-542f-b2aa-d51d8059cef0 with scrape type 1
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e59e9c4c-9bb3-542f-b2aa-d51d8059cef0
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_703452ec92334d69097f2f1582aa5fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_703452ec92334d69097f2f1582aa5fc7.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_331bf09a41a67ac2d1ee9a027c7491b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_331bf09a41a67ac2d1ee9a027c7491b3.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_1b8785534f6f4df134a88b8e8b0e0562.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1b8785534f6f4df134a88b8e8b0e0562.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_7c910ee6392385246e7e3403daf8b475.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7c910ee6392385246e7e3403daf8b475.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_f8a5d93cdd60c99677d0a6f8cafbc4e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_f8a5d93cdd60c99677d0a6f8cafbc4e8.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_0b7b0d3c39f39650c9902b5946269fbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_0b7b0d3c39f39650c9902b5946269fbe.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_1a01b51d20c98ee5f13d1a929e0baa0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1a01b51d20c98ee5f13d1a929e0baa0a.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_2be5e6ced2bdd01943cb85c415e682b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_2be5e6ced2bdd01943cb85c415e682b8.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_47b982090454b3da196a54309f97e508.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_47b982090454b3da196a54309f97e508.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F0a%252Fc50a23d986353e75891d4c697bdcd2e4%252Fpa%252FJA13261_7d4a020dc9e97299762f9b9e364778d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7d4a020dc9e97299762f9b9e364778d4.jpg already downloaded
2026-03-30 07:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e59e9c4c-9bb3-542f-b2aa-d51d8059cef0, identifier: JA13261
2026-03-30 07:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 203c5b9e-2c00-5392-9a33-370fb541ba60 with identifier: ZM89162
2026-03-30 07:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 203c5b9e-2c00-5392-9a33-370fb541ba60 with scrape type 1
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 203c5b9e-2c00-5392-9a33-370fb541ba60
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_c2d09540fc41bbf3bc0dd81c2120188d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_c2d09540fc41bbf3bc0dd81c2120188d.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_146a0f7d628527c854ec3bd9a3aa1cdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_146a0f7d628527c854ec3bd9a3aa1cdf.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_9821e747c2de1ab208b840b583f131ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_9821e747c2de1ab208b840b583f131ff.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_de60bb9e915bb8c47638511846077c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_de60bb9e915bb8c47638511846077c81.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_bb2c57bcb40d000a80ffacb03f103433.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_bb2c57bcb40d000a80ffacb03f103433.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_5edec1cfd33a6338087a7041559d8f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_5edec1cfd33a6338087a7041559d8f5d.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_265e997ce38889617ef9766631d532e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_265e997ce38889617ef9766631d532e7.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_45c0f4c9045a49acd4ceeeebce900b5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_45c0f4c9045a49acd4ceeeebce900b5e.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_8ba394f7968a23703f866b518c5ac507.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_8ba394f7968a23703f866b518c5ac507.jpg already downloaded
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fe1%252F7be18011f0476cbaa60cad0b06d694ea%252Fpa%252FZM89162_b78fe37110a9f6229ba1448436bdc1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_b78fe37110a9f6229ba1448436bdc1f9.jpg already downloaded
2026-03-30 07:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 203c5b9e-2c00-5392-9a33-370fb541ba60, identifier: ZM89162
2026-03-30 07:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f060f462-4381-5bdb-9e58-1aee216e8f4b with identifier: ZX71728
2026-03-30 07:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f060f462-4381-5bdb-9e58-1aee216e8f4b with scrape type 1
2026-03-30 07:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg not downloaded yet
2026-03-30 07:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 020cd00d-99cc-540f-b54a-b9bb8689ece6 with identifier: KP46159
2026-03-30 07:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 020cd00d-99cc-540f-b54a-b9bb8689ece6 with identifier: KP46159
2026-03-30 07:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 020cd00d-99cc-540f-b54a-b9bb8689ece6 with identifier: KP46159 to the API
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:46:00Z',
 'fuel_type': 'petrol',
 'id': '020cd00d-99cc-540f-b54a-b9bb8689ece6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP46159',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 136487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP46159%27 HTTP/1.1" 200 None
2026-03-30 07:33:49 [auto1.de] INFO: Saving data for KP46159: {'auction_closing_time': 1774971960.0, 'created_time': 1774379616.791896, 'last_price_update_time': 1774856029.433935}
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP46159') HTTP/1.1" 204 0
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg not downloaded yet
2026-03-30 07:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e19aa357-eae3-591a-8104-2455ec206d6a with identifier: GD26673
2026-03-30 07:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e19aa357-eae3-591a-8104-2455ec206d6a with identifier: GD26673
2026-03-30 07:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e19aa357-eae3-591a-8104-2455ec206d6a with identifier: GD26673 to the API
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD26673>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:02:15Z',
 'fuel_type': 'petrol',
 'id': 'e19aa357-eae3-591a-8104-2455ec206d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26673',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 165929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5e0b8465d93ac9557af8ac399ae7124a.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2946abe6fb431f2eb4d06b9138211707.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_a01f621ae6f9067eacba64874eeae379.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_f2311fce808b6fa295c220f8480003da.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_1d193ffee96bc4cd9087d3047f334caf.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_34a7929a02bffd3e7a5e632a87894cf9.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5be85b9c2ed42a3f54230a520ec03c44.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_c0d893d28187ea34166430a58ba36cb8.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_68d40445c5145b801119e624f31d9ab6.jpg',
                'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2584c1c52c7a0cb0a91fe308797eedfd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5e0b8465d93ac9557af8ac399ae7124a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2946abe6fb431f2eb4d06b9138211707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_a01f621ae6f9067eacba64874eeae379.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_f2311fce808b6fa295c220f8480003da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_1d193ffee96bc4cd9087d3047f334caf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_34a7929a02bffd3e7a5e632a87894cf9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_5be85b9c2ed42a3f54230a520ec03c44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2818108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_c0d893d28187ea34166430a58ba36cb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2782164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_68d40445c5145b801119e624f31d9ab6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19aa357-eae3-591a-8104-2455ec206d6a/e19aa357-eae3-591a-8104-2455ec206d6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ee/c2ee273803c17d5faa6dc0bdf1f0a895/pa/GD26673_2584c1c52c7a0cb0a91fe308797eedfd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26673%27 HTTP/1.1" 200 None
2026-03-30 07:33:49 [auto1.de] INFO: Saving data for GD26673: {'created_time': 1774856029.795572, 'last_price_update_time': 1774856029.795582, 'auction_closing_time': 1774969335.0}
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD26673') HTTP/1.1" 204 0
2026-03-30 07:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e59e9c4c-9bb3-542f-b2aa-d51d8059cef0 with identifier: JA13261
2026-03-30 07:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e59e9c4c-9bb3-542f-b2aa-d51d8059cef0 with identifier: JA13261
2026-03-30 07:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e59e9c4c-9bb3-542f-b2aa-d51d8059cef0 with identifier: JA13261 to the API
2026-03-30 07:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JA13261>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:13:54Z',
 'fuel_type': 'petrol',
 'id': 'e59e9c4c-9bb3-542f-b2aa-d51d8059cef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA13261',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 211319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_703452ec92334d69097f2f1582aa5fc7.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_331bf09a41a67ac2d1ee9a027c7491b3.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1b8785534f6f4df134a88b8e8b0e0562.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7c910ee6392385246e7e3403daf8b475.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_f8a5d93cdd60c99677d0a6f8cafbc4e8.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_0b7b0d3c39f39650c9902b5946269fbe.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1a01b51d20c98ee5f13d1a929e0baa0a.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_2be5e6ced2bdd01943cb85c415e682b8.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_47b982090454b3da196a54309f97e508.jpg',
                'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7d4a020dc9e97299762f9b9e364778d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_703452ec92334d69097f2f1582aa5fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_331bf09a41a67ac2d1ee9a027c7491b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1b8785534f6f4df134a88b8e8b0e0562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7c910ee6392385246e7e3403daf8b475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_f8a5d93cdd60c99677d0a6f8cafbc4e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_0b7b0d3c39f39650c9902b5946269fbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_1a01b51d20c98ee5f13d1a929e0baa0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_2be5e6ced2bdd01943cb85c415e682b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_47b982090454b3da196a54309f97e508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e59e9c4c-9bb3-542f-b2aa-d51d8059cef0/e59e9c4c-9bb3-542f-b2aa-d51d8059cef0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/0a/c50a23d986353e75891d4c697bdcd2e4/pa/JA13261_7d4a020dc9e97299762f9b9e364778d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA13261%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [auto1.de] INFO: Saving data for JA13261: {'created_time': 1774856030.16555, 'last_price_update_time': 1774856030.165561, 'auction_closing_time': 1774970034.0}
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA13261') HTTP/1.1" 204 0
2026-03-30 07:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 203c5b9e-2c00-5392-9a33-370fb541ba60 with identifier: ZM89162
2026-03-30 07:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 203c5b9e-2c00-5392-9a33-370fb541ba60 with identifier: ZM89162
2026-03-30 07:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 203c5b9e-2c00-5392-9a33-370fb541ba60 with identifier: ZM89162 to the API
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM89162>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:31:37Z',
 'fuel_type': 'diesel',
 'id': '203c5b9e-2c00-5392-9a33-370fb541ba60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM89162',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 221647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_c2d09540fc41bbf3bc0dd81c2120188d.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_146a0f7d628527c854ec3bd9a3aa1cdf.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_9821e747c2de1ab208b840b583f131ff.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_de60bb9e915bb8c47638511846077c81.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_bb2c57bcb40d000a80ffacb03f103433.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_5edec1cfd33a6338087a7041559d8f5d.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_265e997ce38889617ef9766631d532e7.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_45c0f4c9045a49acd4ceeeebce900b5e.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_8ba394f7968a23703f866b518c5ac507.jpg',
                'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_b78fe37110a9f6229ba1448436bdc1f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3081401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_c2d09540fc41bbf3bc0dd81c2120188d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_146a0f7d628527c854ec3bd9a3aa1cdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_9821e747c2de1ab208b840b583f131ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_de60bb9e915bb8c47638511846077c81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_bb2c57bcb40d000a80ffacb03f103433.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_5edec1cfd33a6338087a7041559d8f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_265e997ce38889617ef9766631d532e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_45c0f4c9045a49acd4ceeeebce900b5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_8ba394f7968a23703f866b518c5ac507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203c5b9e-2c00-5392-9a33-370fb541ba60/203c5b9e-2c00-5392-9a33-370fb541ba60_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/e1/7be18011f0476cbaa60cad0b06d694ea/pa/ZM89162_b78fe37110a9f6229ba1448436bdc1f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2015}
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM89162%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [auto1.de] INFO: Saving data for ZM89162: {'created_time': 1774856030.53066, 'last_price_update_time': 1774856030.530672, 'auction_closing_time': 1774971097.0}
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM89162') HTTP/1.1" 204 0
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: AA32108
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA32108%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [auto1.de] INFO: Scrape type for AA32108: 1
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg not downloaded yet
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_50ded59ce0893df09ed90648addfe27c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_de3058fa323b2de243a379ede6508d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_de3058fa323b2de243a379ede6508d39.jpg not downloaded yet
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT22196> (referer: https://www.auto1.com/v1/car-details-view/HT22196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM93215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ09553> (referer: https://www.auto1.com/v1/car-details-view/MJ09553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: ZG21023
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: BB43937
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: XC39500
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC39500%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [auto1.de] INFO: Scrape type for XC39500: 1
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg not downloaded yet
2026-03-30 07:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_34e12d1de774963534157e0642a4ad69.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_34e12d1de774963534157e0642a4ad69.jpg not downloaded yet
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-30 07:33:50 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [auto1.de] INFO: Scrape type for BP51481: 2
2026-03-30 07:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-30 07:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e513c85b-bed3-5b8a-961a-1206066b1754 with scrape type 2
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e513c85b-bed3-5b8a-961a-1206066b1754 with scrape type 2
2026-03-30 07:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e513c85b-bed3-5b8a-961a-1206066b1754, identifier: BP51481
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_67ed52554c17fca02481d92964f9d1b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_67ed52554c17fca02481d92964f9d1b3.jpg not downloaded yet
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3df290>
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg saved to cache
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc451b90>
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_50ded59ce0893df09ed90648addfe27c.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_50ded59ce0893df09ed90648addfe27c.jpg saved to cache
2026-03-30 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-30 07:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-30 07:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481 to the API
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:55:46Z',
 'fuel_type': 'diesel',
 'id': 'e513c85b-bed3-5b8a-961a-1206066b1754',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP51481',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 185102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI clean diesel quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2015}
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [auto1.de] INFO: Saving data for BP51481: {'auction_closing_time': 1774972546.0, 'created_time': 1774262469.479961, 'last_price_update_time': 1774856031.317227}
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP51481') HTTP/1.1" 204 0
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg not downloaded yet
2026-03-30 07:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:51 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [auto1.de] INFO: Scrape type for MU18409: 0
2026-03-30 07:33:51 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-30 07:33:51 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 07:33:51 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg not downloaded yet
2026-03-30 07:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_de3058fa323b2de243a379ede6508d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg not downloaded yet
2026-03-30 07:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 098f6d3b-d317-5400-8e3e-c9a2e0eaae19 with identifier: HT22196
2026-03-30 07:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 098f6d3b-d317-5400-8e3e-c9a2e0eaae19 with scrape type 1
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 098f6d3b-d317-5400-8e3e-c9a2e0eaae19
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_dbb09839e05675ef238c0af7a6028c12.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_dbb09839e05675ef238c0af7a6028c12.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_8389f0d64bcc41c39b0e96171b3fc219.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_8389f0d64bcc41c39b0e96171b3fc219.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_2d1073c5976c97798f824e5583bab22e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_2d1073c5976c97798f824e5583bab22e.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_a78bfcdcab944897a6b42f8e48f7909e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a78bfcdcab944897a6b42f8e48f7909e.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_efd75c518331c41c502282aa59f02f17.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_efd75c518331c41c502282aa59f02f17.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_f22cdde80fb4400e449a83ecd02176db.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_f22cdde80fb4400e449a83ecd02176db.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_c86c167c76bffaac64332593d27d9e31.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_c86c167c76bffaac64332593d27d9e31.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_a3fbb202a8d6acb6c9033a224f254c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a3fbb202a8d6acb6c9033a224f254c71.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_ae40973448564e0626d650d28996588b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_ae40973448564e0626d650d28996588b.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F77514da766537085a28741d317ff4e8b%252Fpa%252FHT22196_07ad3390610468a03e3469af783f782a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_07ad3390610468a03e3469af783f782a.jpg already downloaded
2026-03-30 07:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 098f6d3b-d317-5400-8e3e-c9a2e0eaae19, identifier: HT22196
2026-03-30 07:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c8068e0-55c5-5aa0-a737-18039e0e107e with identifier: MJ09553
2026-03-30 07:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c8068e0-55c5-5aa0-a737-18039e0e107e with scrape type 1
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c8068e0-55c5-5aa0-a737-18039e0e107e
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_a785cd7d0008c1e0af27ced802c41dd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_a785cd7d0008c1e0af27ced802c41dd2.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_7bc1b0ab6bea1165fb10269007dfc8c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_7bc1b0ab6bea1165fb10269007dfc8c2.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_5cba5d46907f70dcfd9862f8ae575fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5cba5d46907f70dcfd9862f8ae575fd0.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_37f4e410622985f2e1c500be48a3c8c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_37f4e410622985f2e1c500be48a3c8c9.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_f2258c8bdde554af65f9e90a4ec2065e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_f2258c8bdde554af65f9e90a4ec2065e.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_61c9870cb6438fdc9035da43dc3c64a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_61c9870cb6438fdc9035da43dc3c64a6.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_8f7003c052976d230c0b64d473e6be50.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_8f7003c052976d230c0b64d473e6be50.jpg already downloaded
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_5889fe107202fd63e21b15c9aa75e3e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5889fe107202fd63e21b15c9aa75e3e1.jpg already downloaded
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_b059e0c450a3c04316792baa6d12b89a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_b059e0c450a3c04316792baa6d12b89a.jpg already downloaded
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fe9%252F88e9cc91c13b453cec83782f74c9a0c0%252Fpa%252FMJ09553_6a8b69ef067bccdb4226c89d65365443.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_6a8b69ef067bccdb4226c89d65365443.jpg already downloaded
2026-03-30 07:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c8068e0-55c5-5aa0-a737-18039e0e107e, identifier: MJ09553
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc95d890>
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg saved to cache
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU97028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 098f6d3b-d317-5400-8e3e-c9a2e0eaae19 with identifier: HT22196
2026-03-30 07:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 098f6d3b-d317-5400-8e3e-c9a2e0eaae19 with identifier: HT22196
2026-03-30 07:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 098f6d3b-d317-5400-8e3e-c9a2e0eaae19 with identifier: HT22196 to the API
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT22196>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:19:04Z',
 'fuel_type': 'petrol',
 'id': '098f6d3b-d317-5400-8e3e-c9a2e0eaae19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT22196',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 123543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_dbb09839e05675ef238c0af7a6028c12.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_8389f0d64bcc41c39b0e96171b3fc219.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_2d1073c5976c97798f824e5583bab22e.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a78bfcdcab944897a6b42f8e48f7909e.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_efd75c518331c41c502282aa59f02f17.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_f22cdde80fb4400e449a83ecd02176db.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_c86c167c76bffaac64332593d27d9e31.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a3fbb202a8d6acb6c9033a224f254c71.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_ae40973448564e0626d650d28996588b.jpg',
                'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_07ad3390610468a03e3469af783f782a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_dbb09839e05675ef238c0af7a6028c12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_8389f0d64bcc41c39b0e96171b3fc219.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_2d1073c5976c97798f824e5583bab22e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a78bfcdcab944897a6b42f8e48f7909e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_efd75c518331c41c502282aa59f02f17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_f22cdde80fb4400e449a83ecd02176db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_c86c167c76bffaac64332593d27d9e31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_a3fbb202a8d6acb6c9033a224f254c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_ae40973448564e0626d650d28996588b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098f6d3b-d317-5400-8e3e-c9a2e0eaae19/098f6d3b-d317-5400-8e3e-c9a2e0eaae19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/77514da766537085a28741d317ff4e8b/pa/HT22196_07ad3390610468a03e3469af783f782a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.4 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2012}
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22196%27 HTTP/1.1" 200 None
2026-03-30 07:33:52 [auto1.de] INFO: Saving data for HT22196: {'created_time': 1774856032.559746, 'last_price_update_time': 1774856032.559762, 'auction_closing_time': 1774970344.0}
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT22196') HTTP/1.1" 204 0
2026-03-30 07:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c8068e0-55c5-5aa0-a737-18039e0e107e with identifier: MJ09553
2026-03-30 07:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c8068e0-55c5-5aa0-a737-18039e0e107e with identifier: MJ09553
2026-03-30 07:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c8068e0-55c5-5aa0-a737-18039e0e107e with identifier: MJ09553 to the API
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ09553>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:50:39Z',
 'fuel_type': 'petrol',
 'id': '5c8068e0-55c5-5aa0-a737-18039e0e107e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ09553',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 69378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_a785cd7d0008c1e0af27ced802c41dd2.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_7bc1b0ab6bea1165fb10269007dfc8c2.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5cba5d46907f70dcfd9862f8ae575fd0.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_37f4e410622985f2e1c500be48a3c8c9.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_f2258c8bdde554af65f9e90a4ec2065e.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_61c9870cb6438fdc9035da43dc3c64a6.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_8f7003c052976d230c0b64d473e6be50.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5889fe107202fd63e21b15c9aa75e3e1.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_b059e0c450a3c04316792baa6d12b89a.jpg',
                'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_6a8b69ef067bccdb4226c89d65365443.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_a785cd7d0008c1e0af27ced802c41dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_7bc1b0ab6bea1165fb10269007dfc8c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5cba5d46907f70dcfd9862f8ae575fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_37f4e410622985f2e1c500be48a3c8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_f2258c8bdde554af65f9e90a4ec2065e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_61c9870cb6438fdc9035da43dc3c64a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_8f7003c052976d230c0b64d473e6be50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_5889fe107202fd63e21b15c9aa75e3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_b059e0c450a3c04316792baa6d12b89a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8068e0-55c5-5aa0-a737-18039e0e107e/5c8068e0-55c5-5aa0-a737-18039e0e107e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/e9/88e9cc91c13b453cec83782f74c9a0c0/pa/MJ09553_6a8b69ef067bccdb4226c89d65365443.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2022}
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ09553%27 HTTP/1.1" 200 None
2026-03-30 07:33:52 [auto1.de] INFO: Saving data for MJ09553: {'created_time': 1774856032.88951, 'last_price_update_time': 1774856032.889521, 'auction_closing_time': 1774972239.0}
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ09553') HTTP/1.1" 204 0
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_34e12d1de774963534157e0642a4ad69.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg not downloaded yet
2026-03-30 07:33:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc745090>
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg saved to cache
2026-03-30 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF54938> (referer: https://www.auto1.com/v1/car-details-view/DF54938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM40779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3c7c10>
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc896190>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc7bc550>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_de3058fa323b2de243a379ede6508d39.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_de3058fa323b2de243a379ede6508d39.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc2ccf50>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_67ed52554c17fca02481d92964f9d1b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3d0d10>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_34e12d1de774963534157e0642a4ad69.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_34e12d1de774963534157e0642a4ad69.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc339410>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41560df-ba4d-58e4-88e5-ee5023110228 with identifier: DF54938
2026-03-30 07:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41560df-ba4d-58e4-88e5-ee5023110228 with scrape type 1
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b41560df-ba4d-58e4-88e5-ee5023110228
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_a98c9e1c157bf7aafbd2c4499eca4f7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_a98c9e1c157bf7aafbd2c4499eca4f7f.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_f83d0cf17f1d74a96f246af6e53133fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f83d0cf17f1d74a96f246af6e53133fd.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_bc674bf7b92e4f5be0f29e9e60c70230.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_bc674bf7b92e4f5be0f29e9e60c70230.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_ed0c87fb8a6658668f7ba19e88364a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_ed0c87fb8a6658668f7ba19e88364a5e.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_35d52e2483555919db75b277c89bae25.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_35d52e2483555919db75b277c89bae25.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_f787b19d1f005b3ec02ba266a5103da1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f787b19d1f005b3ec02ba266a5103da1.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_94e600a80d07502b03d134a5ad44d69f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_94e600a80d07502b03d134a5ad44d69f.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_2d57bcfb6378ac0236aff6888d5a307e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_2d57bcfb6378ac0236aff6888d5a307e.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_06876e45c8078f51974171135508311e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_06876e45c8078f51974171135508311e.jpg already downloaded
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F17%252F981726193ad585a0da34975e210ebc7b%252Fpa%252FDF54938_6dfcedb992f6018a8afb3cbf781c9f11.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_6dfcedb992f6018a8afb3cbf781c9f11.jpg already downloaded
2026-03-30 07:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41560df-ba4d-58e4-88e5-ee5023110228, identifier: DF54938
2026-03-30 07:33:53 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 7430 | hits on page: 40
2026-03-30 07:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41560df-ba4d-58e4-88e5-ee5023110228 with identifier: DF54938
2026-03-30 07:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41560df-ba4d-58e4-88e5-ee5023110228 with identifier: DF54938
2026-03-30 07:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41560df-ba4d-58e4-88e5-ee5023110228 with identifier: DF54938 to the API
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF54938>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:22:40Z',
 'fuel_type': 'diesel',
 'id': 'b41560df-ba4d-58e4-88e5-ee5023110228',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF54938',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'BMW',
 'model': '5er',
 'odometer': 245958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 28,
 'photo_urls': ['https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_a98c9e1c157bf7aafbd2c4499eca4f7f.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f83d0cf17f1d74a96f246af6e53133fd.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_bc674bf7b92e4f5be0f29e9e60c70230.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_ed0c87fb8a6658668f7ba19e88364a5e.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_35d52e2483555919db75b277c89bae25.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f787b19d1f005b3ec02ba266a5103da1.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_94e600a80d07502b03d134a5ad44d69f.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_2d57bcfb6378ac0236aff6888d5a307e.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_06876e45c8078f51974171135508311e.jpg',
                'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_6dfcedb992f6018a8afb3cbf781c9f11.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83541,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_a98c9e1c157bf7aafbd2c4499eca4f7f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83541,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f83d0cf17f1d74a96f246af6e53133fd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141526,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_bc674bf7b92e4f5be0f29e9e60c70230.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_ed0c87fb8a6658668f7ba19e88364a5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137198,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_35d52e2483555919db75b277c89bae25.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83171,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_f787b19d1f005b3ec02ba266a5103da1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76246,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_94e600a80d07502b03d134a5ad44d69f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85632,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_2d57bcfb6378ac0236aff6888d5a307e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28025,
             'Height': 240,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_06876e45c8078f51974171135508311e.jpg',
             'Width': 320},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b41560df-ba4d-58e4-88e5-ee5023110228/b41560df-ba4d-58e4-88e5-ee5023110228_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69978,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img98/17/981726193ad585a0da34975e210ebc7b/pa/DF54938_6dfcedb992f6018a8afb3cbf781c9f11.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 540d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2018}
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF54938%27 HTTP/1.1" 200 None
2026-03-30 07:33:53 [auto1.de] INFO: Saving data for DF54938: {'created_time': 1774856033.872014, 'last_price_update_time': 1774856033.872027, 'auction_closing_time': 1774970560.0}
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF54938') HTTP/1.1" 204 0
2026-03-30 07:33:53 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 07:33:53 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc48eb50>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_67ed52554c17fca02481d92964f9d1b3.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_67ed52554c17fca02481d92964f9d1b3.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc86ea90>
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg saved to cache
2026-03-30 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:53 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 07:33:53 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP46159%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for KP46159: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: AA32108
2026-03-30 07:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY77324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA32108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP95743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: ZG21023
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: BB43937
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: XC39500
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for BP51481: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for MU18409: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for GT74179: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for ZP13586: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for YW85241: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for UX63116: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for BX27275: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for XK12555: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 07:33:54 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-30 07:33:54 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3e3d50>
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fae%252F56aec917c0f27e18090badf87c66f797%252Fpa%252FZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg saved to cache
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f060f462-4381-5bdb-9e58-1aee216e8f4b
2026-03-30 07:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f060f462-4381-5bdb-9e58-1aee216e8f4b, skipping ID generation
2026-03-30 07:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f060f462-4381-5bdb-9e58-1aee216e8f4b with scrape type 1
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f060f462-4381-5bdb-9e58-1aee216e8f4b sending to next pipeline
2026-03-30 07:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f060f462-4381-5bdb-9e58-1aee216e8f4b, identifier: ZX71728
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc85a4d0>
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg saved to cache
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71beb10310>
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7a%252Fd87afbbf01d1c111f80daba013238ad6%252Fpa%252FSJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg') HTTP/1.1" 204 0
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg saved to cache
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc
2026-03-30 07:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc, skipping ID generation
2026-03-30 07:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with scrape type 1
2026-03-30 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92502916-30f3-5ce3-9db3-45b6c8d0b1bc sending to next pipeline
2026-03-30 07:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc, identifier: SJ00642
2026-03-30 07:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f060f462-4381-5bdb-9e58-1aee216e8f4b with identifier: ZX71728
2026-03-30 07:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f060f462-4381-5bdb-9e58-1aee216e8f4b with identifier: ZX71728
2026-03-30 07:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f060f462-4381-5bdb-9e58-1aee216e8f4b with identifier: ZX71728 to the API
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:12:23Z',
 'fuel_type': 'petrol',
 'id': 'f060f462-4381-5bdb-9e58-1aee216e8f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX71728',
 'listing': 'auction',
 'location': 'DE, Bretzenheim',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 179030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_8b68d77f5d7c9f2beaf58b9e250ad93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d98d62ff5ca79c72941b3bfbecb490d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_d332f5fe2d8b3f894c785b82dfe14977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_67ed52554c17fca02481d92964f9d1b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f060f462-4381-5bdb-9e58-1aee216e8f4b/f060f462-4381-5bdb-9e58-1aee216e8f4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ae/56aec917c0f27e18090badf87c66f797/pa/ZX71728_473c2d64748b87c624cf4fe7fd95d704.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX71728%27 HTTP/1.1" 200 None
2026-03-30 07:33:55 [auto1.de] INFO: Saving data for ZX71728: {'created_time': 1774856035.052911, 'last_price_update_time': 1774856035.052923, 'auction_closing_time': 1774969943.0}
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX71728') HTTP/1.1" 204 0
2026-03-30 07:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with identifier: SJ00642
2026-03-30 07:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with identifier: SJ00642
2026-03-30 07:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92502916-30f3-5ce3-9db3-45b6c8d0b1bc with identifier: SJ00642 to the API
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '92502916-30f3-5ce3-9db3-45b6c8d0b1bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ00642',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 49309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c006ffa5df5b55bb0d0ebd01cefcc141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_50ded59ce0893df09ed90648addfe27c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f474b3c01c72f1d101015959e3e9fcfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_f6447b0c21f0111b5b5c2e08d63cb819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_c1ff20eccc9c957707f7a55325e5db8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_de3058fa323b2de243a379ede6508d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_34e12d1de774963534157e0642a4ad69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_87fde5c76e3fafb9e3e7b716ffda9e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_1e2b0d7fa4463dc51fa1c4c6720685ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92502916-30f3-5ce3-9db3-45b6c8d0b1bc/92502916-30f3-5ce3-9db3-45b6c8d0b1bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7a/d87afbbf01d1c111f80daba013238ad6/pa/SJ00642_441fda5542dfbbe1d8de9019f1d47575.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ00642%27 HTTP/1.1" 200 None
2026-03-30 07:33:55 [auto1.de] INFO: Saving data for SJ00642: {'created_time': 1774856035.54048, 'last_price_update_time': 1774856035.540491, 'auction_closing_time': 1774972318.0}
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ00642') HTTP/1.1" 204 0
2026-03-30 07:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC39500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU97028> (referer: https://www.auto1.com/v1/car-details-view/XU97028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM40779> (referer: https://www.auto1.com/v1/car-details-view/WM40779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM93215> (referer: https://www.auto1.com/v1/car-details-view/DM93215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babd62c9-134e-55c6-af45-2f21614b8e4f with identifier: XU97028
2026-03-30 07:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babd62c9-134e-55c6-af45-2f21614b8e4f with scrape type 1
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item babd62c9-134e-55c6-af45-2f21614b8e4f
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_406c29a2e81fc1368a9507598f5d231a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_406c29a2e81fc1368a9507598f5d231a.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_d96f5516999eaf64aac791c356943003.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d96f5516999eaf64aac791c356943003.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_42736a5201e698056e8f00ad8cdd965a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_42736a5201e698056e8f00ad8cdd965a.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_b0cb1e04161acf81fb7a1705f91191f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_b0cb1e04161acf81fb7a1705f91191f8.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_81ed0a9a82add729bc73d4db83e43754.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_81ed0a9a82add729bc73d4db83e43754.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_20d230cda57be2f4cf9f592e66b1763f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_20d230cda57be2f4cf9f592e66b1763f.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_d38317a96bb0d8131a1f6fc03176dc82.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d38317a96bb0d8131a1f6fc03176dc82.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_7480f67d507190b09c4b740a0a810a41.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_7480f67d507190b09c4b740a0a810a41.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_80fcd277537acc85c11304431bbbc63f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_80fcd277537acc85c11304431bbbc63f.jpg already downloaded
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fb7%252F08b769242fe92e9fe57916a04d2ff586%252Fpa%252FXU97028_8c0d157724f0ec3466e220b0ad450058.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_8c0d157724f0ec3466e220b0ad450058.jpg already downloaded
2026-03-30 07:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: babd62c9-134e-55c6-af45-2f21614b8e4f, identifier: XU97028
2026-03-30 07:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: babd62c9-134e-55c6-af45-2f21614b8e4f with identifier: XU97028
2026-03-30 07:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: babd62c9-134e-55c6-af45-2f21614b8e4f with identifier: XU97028
2026-03-30 07:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: babd62c9-134e-55c6-af45-2f21614b8e4f with identifier: XU97028 to the API
2026-03-30 07:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XU97028>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:58:57Z',
 'fuel_type': 'petrol',
 'id': 'babd62c9-134e-55c6-af45-2f21614b8e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU97028',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 69715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_406c29a2e81fc1368a9507598f5d231a.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d96f5516999eaf64aac791c356943003.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_42736a5201e698056e8f00ad8cdd965a.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_b0cb1e04161acf81fb7a1705f91191f8.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_81ed0a9a82add729bc73d4db83e43754.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_20d230cda57be2f4cf9f592e66b1763f.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d38317a96bb0d8131a1f6fc03176dc82.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_7480f67d507190b09c4b740a0a810a41.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_80fcd277537acc85c11304431bbbc63f.jpg',
                'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_8c0d157724f0ec3466e220b0ad450058.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_406c29a2e81fc1368a9507598f5d231a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2187157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d96f5516999eaf64aac791c356943003.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_42736a5201e698056e8f00ad8cdd965a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_b0cb1e04161acf81fb7a1705f91191f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_81ed0a9a82add729bc73d4db83e43754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_20d230cda57be2f4cf9f592e66b1763f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2390936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_d38317a96bb0d8131a1f6fc03176dc82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_7480f67d507190b09c4b740a0a810a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_80fcd277537acc85c11304431bbbc63f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_babd62c9-134e-55c6-af45-2f21614b8e4f/babd62c9-134e-55c6-af45-2f21614b8e4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/b7/08b769242fe92e9fe57916a04d2ff586/pa/XU97028_8c0d157724f0ec3466e220b0ad450058.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU97028%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [auto1.de] INFO: Saving data for XU97028: {'created_time': 1774856037.229867, 'last_price_update_time': 1774856037.229882, 'auction_closing_time': 1774972737.0}
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU97028') HTTP/1.1" 204 0
2026-03-30 07:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA32108> (referer: https://www.auto1.com/v1/car-details-view/AA32108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP95743> (referer: https://www.auto1.com/v1/car-details-view/VP95743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY77324> (referer: https://www.auto1.com/v1/car-details-view/CY77324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddff132-ecc3-50b4-8575-18b5b74030e6 with identifier: WM40779
2026-03-30 07:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddff132-ecc3-50b4-8575-18b5b74030e6 with scrape type 1
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ddff132-ecc3-50b4-8575-18b5b74030e6
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_909ff88b706b1493e7b835ebc8759754.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_909ff88b706b1493e7b835ebc8759754.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_fabd847a246d1696de6e49f5931476de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_fabd847a246d1696de6e49f5931476de.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_a90d4452ad4c02004a903dd4dd2b85b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_a90d4452ad4c02004a903dd4dd2b85b7.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_f88add62855986744f337efc6cd1a0a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f88add62855986744f337efc6cd1a0a2.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_b8a63d6aa77df9a83581eea665e775ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_b8a63d6aa77df9a83581eea665e775ee.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_f4ad7f4cb26476a3b4b8a1be8658be3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f4ad7f4cb26476a3b4b8a1be8658be3e.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_8f99e7b16cee2628951034f58c6a50b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_8f99e7b16cee2628951034f58c6a50b5.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_f42536986fdbb7f6e79e81df4a55c8ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f42536986fdbb7f6e79e81df4a55c8ef.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_64b5dcbbc6e792e140b896dd7e345ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_64b5dcbbc6e792e140b896dd7e345ff4.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb1%252F03b174a331dfba8510bcb81121bddeb6%252Fpa%252FWM40779_4141affefe0ab7cf6ed0f2627c408266.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_4141affefe0ab7cf6ed0f2627c408266.jpg already downloaded
2026-03-30 07:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ddff132-ecc3-50b4-8575-18b5b74030e6, identifier: WM40779
2026-03-30 07:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162fde44-99e1-5c05-8278-b0ef23f10cd6 with identifier: DM93215
2026-03-30 07:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162fde44-99e1-5c05-8278-b0ef23f10cd6 with scrape type 1
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 162fde44-99e1-5c05-8278-b0ef23f10cd6
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_87292c7fc428cbbdb0185ddad26807e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_87292c7fc428cbbdb0185ddad26807e3.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_132f49978d7f2f2cd1be109cf4b589f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_132f49978d7f2f2cd1be109cf4b589f5.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_a97eceacb3da0bd902cd8ef1cdf09880.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_a97eceacb3da0bd902cd8ef1cdf09880.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_ee8c32ee1b846d016ea6b7b2e51641ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_ee8c32ee1b846d016ea6b7b2e51641ba.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_b5581d71dc21a0e50b4a66323b153ca0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b5581d71dc21a0e50b4a66323b153ca0.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_b97dc5a7330712b16fbcd6f9c9999c85.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b97dc5a7330712b16fbcd6f9c9999c85.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_5e1e361915a30d2bc8ea71ca4c67a3d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_5e1e361915a30d2bc8ea71ca4c67a3d2.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_17fbc4a9d90851e3d69578fd2464ba30.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_17fbc4a9d90851e3d69578fd2464ba30.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_91033a185fa0e8204ef7ebe96ed05706.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_91033a185fa0e8204ef7ebe96ed05706.jpg already downloaded
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F99%252F22991b83bf0f9b5d73bd4835233529f6%252Fpa%252FDM93215_c9dcdd6d4a4623870a90f25277785d83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_c9dcdd6d4a4623870a90f25277785d83.jpg already downloaded
2026-03-30 07:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 162fde44-99e1-5c05-8278-b0ef23f10cd6, identifier: DM93215
2026-03-30 07:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ddff132-ecc3-50b4-8575-18b5b74030e6 with identifier: WM40779
2026-03-30 07:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ddff132-ecc3-50b4-8575-18b5b74030e6 with identifier: WM40779
2026-03-30 07:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ddff132-ecc3-50b4-8575-18b5b74030e6 with identifier: WM40779 to the API
2026-03-30 07:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM40779>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:03:55Z',
 'fuel_type': 'petrol',
 'id': '7ddff132-ecc3-50b4-8575-18b5b74030e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM40779',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 95244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_909ff88b706b1493e7b835ebc8759754.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_fabd847a246d1696de6e49f5931476de.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_a90d4452ad4c02004a903dd4dd2b85b7.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f88add62855986744f337efc6cd1a0a2.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_b8a63d6aa77df9a83581eea665e775ee.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f4ad7f4cb26476a3b4b8a1be8658be3e.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_8f99e7b16cee2628951034f58c6a50b5.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f42536986fdbb7f6e79e81df4a55c8ef.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_64b5dcbbc6e792e140b896dd7e345ff4.jpg',
                'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_4141affefe0ab7cf6ed0f2627c408266.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_909ff88b706b1493e7b835ebc8759754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_fabd847a246d1696de6e49f5931476de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_a90d4452ad4c02004a903dd4dd2b85b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f88add62855986744f337efc6cd1a0a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_b8a63d6aa77df9a83581eea665e775ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f4ad7f4cb26476a3b4b8a1be8658be3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_8f99e7b16cee2628951034f58c6a50b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_f42536986fdbb7f6e79e81df4a55c8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_64b5dcbbc6e792e140b896dd7e345ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ddff132-ecc3-50b4-8575-18b5b74030e6/7ddff132-ecc3-50b4-8575-18b5b74030e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b1/03b174a331dfba8510bcb81121bddeb6/pa/WM40779_4141affefe0ab7cf6ed0f2627c408266.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM40779%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [auto1.de] INFO: Saving data for WM40779: {'created_time': 1774856038.193565, 'last_price_update_time': 1774856038.193577, 'auction_closing_time': 1774969435.0}
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM40779') HTTP/1.1" 204 0
2026-03-30 07:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 162fde44-99e1-5c05-8278-b0ef23f10cd6 with identifier: DM93215
2026-03-30 07:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 162fde44-99e1-5c05-8278-b0ef23f10cd6 with identifier: DM93215
2026-03-30 07:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 162fde44-99e1-5c05-8278-b0ef23f10cd6 with identifier: DM93215 to the API
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM93215>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-03-31T15:55:41Z',
 'fuel_type': 'hybrid',
 'id': '162fde44-99e1-5c05-8278-b0ef23f10cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM93215',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 103939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_87292c7fc428cbbdb0185ddad26807e3.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_132f49978d7f2f2cd1be109cf4b589f5.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_a97eceacb3da0bd902cd8ef1cdf09880.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_ee8c32ee1b846d016ea6b7b2e51641ba.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b5581d71dc21a0e50b4a66323b153ca0.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b97dc5a7330712b16fbcd6f9c9999c85.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_5e1e361915a30d2bc8ea71ca4c67a3d2.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_17fbc4a9d90851e3d69578fd2464ba30.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_91033a185fa0e8204ef7ebe96ed05706.jpg',
                'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_c9dcdd6d4a4623870a90f25277785d83.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_87292c7fc428cbbdb0185ddad26807e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_132f49978d7f2f2cd1be109cf4b589f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_a97eceacb3da0bd902cd8ef1cdf09880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_ee8c32ee1b846d016ea6b7b2e51641ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b5581d71dc21a0e50b4a66323b153ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_b97dc5a7330712b16fbcd6f9c9999c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_5e1e361915a30d2bc8ea71ca4c67a3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_17fbc4a9d90851e3d69578fd2464ba30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_91033a185fa0e8204ef7ebe96ed05706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162fde44-99e1-5c05-8278-b0ef23f10cd6/162fde44-99e1-5c05-8278-b0ef23f10cd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/99/22991b83bf0f9b5d73bd4835233529f6/pa/DM93215_c9dcdd6d4a4623870a90f25277785d83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM93215%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [auto1.de] INFO: Saving data for DM93215: {'created_time': 1774856038.556014, 'last_price_update_time': 1774856038.556026, 'auction_closing_time': 1774972541.0}
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM93215') HTTP/1.1" 204 0
2026-03-30 07:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7378ab9-781d-5f50-b508-c4a062b7abf0 with identifier: AA32108
2026-03-30 07:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7378ab9-781d-5f50-b508-c4a062b7abf0 with scrape type 1
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7378ab9-781d-5f50-b508-c4a062b7abf0
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_525a4b1d6f60385f2484cc77ef52d189.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_525a4b1d6f60385f2484cc77ef52d189.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_275383cc3f88f736b810fca6f43cf7da.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_275383cc3f88f736b810fca6f43cf7da.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_5077ad14a55288d01e511eda493729f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_5077ad14a55288d01e511eda493729f4.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_4ec6adb3501ddc4fde5f7526ff192452.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_4ec6adb3501ddc4fde5f7526ff192452.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_b631be76749c3d39a74d9fa67c4ee0b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_b631be76749c3d39a74d9fa67c4ee0b1.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_99405d01bc1ff99d178b111e632fe3fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_99405d01bc1ff99d178b111e632fe3fa.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_518b8b792725246913993e0851f55662.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_518b8b792725246913993e0851f55662.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_80c8ef2c8ac56f1a16fbb4b2c2ed2c08.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_80c8ef2c8ac56f1a16fbb4b2c2ed2c08.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_cb98a0d0899ca703f6b3fecebc2e2812.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_cb98a0d0899ca703f6b3fecebc2e2812.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fbc%252Fedbc2e53e021744a790a21b8c8d26141%252Fpa%252FAA32108_07322f098211caee17c913b36db815bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_07322f098211caee17c913b36db815bd.jpg already downloaded
2026-03-30 07:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7378ab9-781d-5f50-b508-c4a062b7abf0, identifier: AA32108
2026-03-30 07:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3584f5-e831-5211-b38b-9a20c0ab1d6d with identifier: VP95743
2026-03-30 07:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3584f5-e831-5211-b38b-9a20c0ab1d6d with scrape type 1
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e3584f5-e831-5211-b38b-9a20c0ab1d6d
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_73d2a5f154c061c58709e126e7b74a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_73d2a5f154c061c58709e126e7b74a63.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_8a13df7ac9bbf32b4ae6d945f76d5fe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8a13df7ac9bbf32b4ae6d945f76d5fe0.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_70a2f7034b9512b2b9d9c5727fea6684.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_70a2f7034b9512b2b9d9c5727fea6684.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_510c2d5c82e97485d9fa50f3a845112a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_510c2d5c82e97485d9fa50f3a845112a.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_9c0a52c31b87ed2b74f4c249e06276f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_9c0a52c31b87ed2b74f4c249e06276f6.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_1bb2f3cd6b3801a279042dca6d048096.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_1bb2f3cd6b3801a279042dca6d048096.jpg already downloaded
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_b7bc85a81026191ed02bfa9d5c013e00.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_b7bc85a81026191ed02bfa9d5c013e00.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_ea6d24b9efe273bd56492950ad898da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_ea6d24b9efe273bd56492950ad898da8.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_8401ccef65b913966185f2f2dc2f91b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8401ccef65b913966185f2f2dc2f91b2.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa6%252F75a6c6cc460d8dcfb5d1903499e5ccba%252Fpa%252FVP95743_f81103db48c6d705c5e96ec2de49a8c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_f81103db48c6d705c5e96ec2de49a8c2.jpg already downloaded
2026-03-30 07:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3584f5-e831-5211-b38b-9a20c0ab1d6d, identifier: VP95743
2026-03-30 07:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-03-30 07:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3a20c4-4892-53c7-9a01-26342a24560a with scrape type 1
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c3a20c4-4892-53c7-9a01-26342a24560a
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_ed7d72ffea3d260ae43b6096df534e12.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_ce032ec6c9a243afb69542f1b8089214.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_db33844c9b55b450ba4571e794ed1c1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_0e881a76f067c95f82f8236fc3c08f69.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_e4596765a5e6f63ec4b9866bb979d682.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_afb8bbb8d134fd233024757dc5009604.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_ac1fde94394d4162d8d864717e322a90.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg already downloaded
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F20%252F6620b1ed95fba7f82fee02464deb1ca1%252Fpa%252FCY77324_8b9a550c1972af0afae56e2080e8707c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg already downloaded
2026-03-30 07:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3a20c4-4892-53c7-9a01-26342a24560a, identifier: CY77324
2026-03-30 07:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7378ab9-781d-5f50-b508-c4a062b7abf0 with identifier: AA32108
2026-03-30 07:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7378ab9-781d-5f50-b508-c4a062b7abf0 with identifier: AA32108
2026-03-30 07:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7378ab9-781d-5f50-b508-c4a062b7abf0 with identifier: AA32108 to the API
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AA32108>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:00Z',
 'fuel_type': 'petrol',
 'id': 'e7378ab9-781d-5f50-b508-c4a062b7abf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA32108',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 43191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_525a4b1d6f60385f2484cc77ef52d189.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_275383cc3f88f736b810fca6f43cf7da.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_5077ad14a55288d01e511eda493729f4.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_4ec6adb3501ddc4fde5f7526ff192452.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_b631be76749c3d39a74d9fa67c4ee0b1.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_99405d01bc1ff99d178b111e632fe3fa.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_518b8b792725246913993e0851f55662.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_80c8ef2c8ac56f1a16fbb4b2c2ed2c08.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_cb98a0d0899ca703f6b3fecebc2e2812.jpg',
                'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_07322f098211caee17c913b36db815bd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_525a4b1d6f60385f2484cc77ef52d189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_275383cc3f88f736b810fca6f43cf7da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_5077ad14a55288d01e511eda493729f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_4ec6adb3501ddc4fde5f7526ff192452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_b631be76749c3d39a74d9fa67c4ee0b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_99405d01bc1ff99d178b111e632fe3fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_518b8b792725246913993e0851f55662.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_80c8ef2c8ac56f1a16fbb4b2c2ed2c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_cb98a0d0899ca703f6b3fecebc2e2812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7378ab9-781d-5f50-b508-c4a062b7abf0/e7378ab9-781d-5f50-b508-c4a062b7abf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/bc/edbc2e53e021744a790a21b8c8d26141/pa/AA32108_07322f098211caee17c913b36db815bd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA32108%27 HTTP/1.1" 200 None
2026-03-30 07:33:59 [auto1.de] INFO: Saving data for AA32108: {'created_time': 1774856039.79404, 'last_price_update_time': 1774856039.794051, 'auction_closing_time': 1774972080.0}
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA32108') HTTP/1.1" 204 0
2026-03-30 07:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3584f5-e831-5211-b38b-9a20c0ab1d6d with identifier: VP95743
2026-03-30 07:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3584f5-e831-5211-b38b-9a20c0ab1d6d with identifier: VP95743
2026-03-30 07:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3584f5-e831-5211-b38b-9a20c0ab1d6d with identifier: VP95743 to the API
2026-03-30 07:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP95743>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:39:42Z',
 'fuel_type': 'petrol',
 'id': '3e3584f5-e831-5211-b38b-9a20c0ab1d6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP95743',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 147612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_73d2a5f154c061c58709e126e7b74a63.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8a13df7ac9bbf32b4ae6d945f76d5fe0.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_70a2f7034b9512b2b9d9c5727fea6684.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_510c2d5c82e97485d9fa50f3a845112a.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_9c0a52c31b87ed2b74f4c249e06276f6.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_1bb2f3cd6b3801a279042dca6d048096.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_b7bc85a81026191ed02bfa9d5c013e00.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_ea6d24b9efe273bd56492950ad898da8.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8401ccef65b913966185f2f2dc2f91b2.jpg',
                'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_f81103db48c6d705c5e96ec2de49a8c2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_73d2a5f154c061c58709e126e7b74a63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8a13df7ac9bbf32b4ae6d945f76d5fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_70a2f7034b9512b2b9d9c5727fea6684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_510c2d5c82e97485d9fa50f3a845112a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_9c0a52c31b87ed2b74f4c249e06276f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_1bb2f3cd6b3801a279042dca6d048096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_b7bc85a81026191ed02bfa9d5c013e00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_ea6d24b9efe273bd56492950ad898da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_8401ccef65b913966185f2f2dc2f91b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e3584f5-e831-5211-b38b-9a20c0ab1d6d/3e3584f5-e831-5211-b38b-9a20c0ab1d6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/a6/75a6c6cc460d8dcfb5d1903499e5ccba/pa/VP95743_f81103db48c6d705c5e96ec2de49a8c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95743%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Saving data for VP95743: {'created_time': 1774856040.169751, 'last_price_update_time': 1774856040.169761, 'auction_closing_time': 1774971582.0}
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP95743') HTTP/1.1" 204 0
2026-03-30 07:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-03-30 07:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324
2026-03-30 07:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3a20c4-4892-53c7-9a01-26342a24560a with identifier: CY77324 to the API
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY77324>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:47:12Z',
 'fuel_type': 'petrol',
 'id': '2c3a20c4-4892-53c7-9a01-26342a24560a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY77324',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 60903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg',
                'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46556,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ed7d72ffea3d260ae43b6096df534e12.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49356,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ce032ec6c9a243afb69542f1b8089214.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44344,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_db33844c9b55b450ba4571e794ed1c1e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33798,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_0e881a76f067c95f82f8236fc3c08f69.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44938,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_e4596765a5e6f63ec4b9866bb979d682.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54052,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_d6a0005fdc78a4fd48b78b685ae381d8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244158,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_afb8bbb8d134fd233024757dc5009604.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41841,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_bf85b3ab8f69e0dd505e6e4084fb75c0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282465,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_ac1fde94394d4162d8d864717e322a90.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c3a20c4-4892-53c7-9a01-26342a24560a/2c3a20c4-4892-53c7-9a01-26342a24560a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46912,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img66/20/6620b1ed95fba7f82fee02464deb1ca1/pa/CY77324_8b9a550c1972af0afae56e2080e8707c.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-X Mild-Hybrid Selection 2WD',
 'transmission': 'automatic',
 'trim': 'Selection 2WD',
 'year': 2021}
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY77324%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Saving data for CY77324: {'created_time': 1774856040.504862, 'last_price_update_time': 1774856040.504873, 'auction_closing_time': 1774972032.0}
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY77324') HTTP/1.1" 204 0
2026-03-30 07:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC39500> (referer: https://www.auto1.com/v1/car-details-view/XC39500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT72839> (referer: https://www.auto1.com/v1/car-details-view/HT72839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:00 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 7444 | hits on page: 40
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for HM22337: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for JM25076: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for CR70620: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for PX43483: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for KS38701: 0
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 07:34:00 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [auto1.de] INFO: Scrape type for LN64409: 0
2026-03-30 07:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with identifier: XC39500
2026-03-30 07:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with scrape type 1
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg not downloaded yet
2026-03-30 07:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-03-30 07:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with scrape type 1
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3413be3-2c20-5cc8-8f27-30a1e7aa94d7
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg already downloaded
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_4f768013f375078f1062dc719070ce2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg already downloaded
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_9d6765122a54a62a427a168e662d644f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg already downloaded
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_091c92a464e9e62f8170380f094c7042.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_daf0ad18e800548c28e63628be1f7d43.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg already downloaded
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F49%252F3b49b1796683d82bfe5090f6ab024c56%252Fpa%252FHT72839_99a3a83e4bc096c7a609be96345adda8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg already downloaded
2026-03-30 07:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7, identifier: HT72839
2026-03-30 07:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-03-30 07:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839
2026-03-30 07:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3413be3-2c20-5cc8-8f27-30a1e7aa94d7 with identifier: HT72839 to the API
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT72839>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:13:18Z',
 'fuel_type': 'petrol',
 'id': 'f3413be3-2c20-5cc8-8f27-30a1e7aa94d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT72839',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 100902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg',
                'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_cb5330b315b3a34ff1fa3f1ced2996e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_4f768013f375078f1062dc719070ce2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_9d6765122a54a62a427a168e662d644f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_e807f5ac527b3a87ebd8dc4a8e8a3966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_95bd8f3541a833d7940c3e9a8ebaf6d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_6c9ce1bc08c013f310c6d21feeed0594.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_091c92a464e9e62f8170380f094c7042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2850987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_daf0ad18e800548c28e63628be1f7d43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_da302d62e98e79293ffc996cdf0ba3c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3413be3-2c20-5cc8-8f27-30a1e7aa94d7/f3413be3-2c20-5cc8-8f27-30a1e7aa94d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2969736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/49/3b49b1796683d82bfe5090f6ab024c56/pa/HT72839_99a3a83e4bc096c7a609be96345adda8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2018}
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT72839%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [auto1.de] INFO: Saving data for HT72839: {'created_time': 1774856041.570795, 'last_price_update_time': 1774856041.570808, 'auction_closing_time': 1774969998.0}
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT72839') HTTP/1.1" 204 0
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_50a473abd1049a00e8e6184cd679834a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_50a473abd1049a00e8e6184cd679834a.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_2be9de901270e76181b2d5bb96f92999.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_2be9de901270e76181b2d5bb96f92999.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_85069c0bbec06673957a0c3da718272b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85069c0bbec06673957a0c3da718272b.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_4154ded32b253d5b9c8897d61accc989.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_4154ded32b253d5b9c8897d61accc989.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg not downloaded yet
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_50a473abd1049a00e8e6184cd679834a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_85cdec93241bc44808aa0d24144ac1e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85cdec93241bc44808aa0d24144ac1e7.jpg not downloaded yet
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_f6333dda4e4174d829363c567c61fb4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_f6333dda4e4174d829363c567c61fb4c.jpg not downloaded yet
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_2be9de901270e76181b2d5bb96f92999.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85069c0bbec06673957a0c3da718272b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_838607ea065ca025c0a7b7c631e2752f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_838607ea065ca025c0a7b7c631e2752f.jpg not downloaded yet
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_4154ded32b253d5b9c8897d61accc989.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bca4a350>
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg saved to cache
2026-03-30 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc769990>
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_50a473abd1049a00e8e6184cd679834a.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_50a473abd1049a00e8e6184cd679834a.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85cdec93241bc44808aa0d24144ac1e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_f6333dda4e4174d829363c567c61fb4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_838607ea065ca025c0a7b7c631e2752f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc68ca50>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_2be9de901270e76181b2d5bb96f92999.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_2be9de901270e76181b2d5bb96f92999.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc3ded90>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_85069c0bbec06673957a0c3da718272b.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85069c0bbec06673957a0c3da718272b.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc625350>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_4154ded32b253d5b9c8897d61accc989.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_4154ded32b253d5b9c8897d61accc989.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc6fb650>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc852650>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc749990>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_85cdec93241bc44808aa0d24144ac1e7.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85cdec93241bc44808aa0d24144ac1e7.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc97cd50>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_f6333dda4e4174d829363c567c61fb4c.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_f6333dda4e4174d829363c567c61fb4c.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71bc89ac50>
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a65c0bafbeed10e291f9d43dd4d47b%252Fpa%252FXC39500_838607ea065ca025c0a7b7c631e2752f.jpg') HTTP/1.1" 204 0
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_838607ea065ca025c0a7b7c631e2752f.jpg saved to cache
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3
2026-03-30 07:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3, skipping ID generation
2026-03-30 07:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with scrape type 1
2026-03-30 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 sending to next pipeline
2026-03-30 07:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3, identifier: XC39500
2026-03-30 07:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with identifier: XC39500
2026-03-30 07:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with identifier: XC39500
2026-03-30 07:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a9884e-7fb6-5f33-9526-8b8c5ea35aa3 with identifier: XC39500 to the API
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_838607ea065ca025c0a7b7c631e2752f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:19:20Z',
 'fuel_type': 'petrol',
 'id': '13a9884e-7fb6-5f33-9526-8b8c5ea35aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC39500',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 59920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_3c3af0ec8dd2810e788a843f5f3afd96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_50a473abd1049a00e8e6184cd679834a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_2be9de901270e76181b2d5bb96f92999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85069c0bbec06673957a0c3da718272b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_4154ded32b253d5b9c8897d61accc989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_e0197bae3daca5e6eb541c81e5e5c310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_8833781cdf776a3dfd1d19a1f8fbfbb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_85cdec93241bc44808aa0d24144ac1e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_f6333dda4e4174d829363c567c61fb4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a9884e-7fb6-5f33-9526-8b8c5ea35aa3/13a9884e-7fb6-5f33-9526-8b8c5ea35aa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a65c0bafbeed10e291f9d43dd4d47b/pa/XC39500_838607ea065ca025c0a7b7c631e2752f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2015}
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC39500%27 HTTP/1.1" 200 None
2026-03-30 07:34:02 [auto1.de] INFO: Saving data for XC39500: {'created_time': 1774856042.8766, 'last_price_update_time': 1774856042.876613, 'auction_closing_time': 1774970360.0}
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC39500') HTTP/1.1" 204 0
2026-03-30 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:03 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 7450 | hits on page: 40
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for KS38701: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for LN64409: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for UG24074: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for EM69588: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for RA38840: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for XN76849: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for WW07339: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for UH53806: 0
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-30 07:34:03 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-30 07:34:03 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-30 07:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:04 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 7451 | hits on page: 40
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for GT35568: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for TJ90592: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for RG53469: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for DS41181: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for WY61426: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for UL88623: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for BV67523: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for NW01649: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for SN44411: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for VR35896: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for JT14161: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for LN95655: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for HP19661: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-30 07:34:04 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-30 07:34:04 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-30 07:34:05 [auto1.de] INFO: Scrape type for WG22836: 0
2026-03-30 07:34:05 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 07:34:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:06 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 7453 | hits on page: 40
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for WG22836: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for VF27943: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for TU72063: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for AF05413: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for YW33550: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for RT89872: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for VN24673: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for AA02702: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for KG90894: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for WX41278: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for RC66900: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for FF58085: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for TR94323: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for EJ33834: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for FN39592: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for YV56430: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 07:34:06 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-30 07:34:06 [auto1.de] INFO: Scrape type for EC15325: 0
2026-03-30 07:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:06 [scrapy.extensions.logstats] INFO: Crawled 214 pages (at 66 pages/min), scraped 251 items (at 83 items/min)
2026-03-30 07:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:07 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 7457 | hits on page: 40
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for YV56430: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for EC15325: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for XW84981: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for XE54390: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: US93398
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for US93398: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for ZL28977: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for XW55257: 0
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 07:34:07 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-30 07:34:07 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-30 07:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:09 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 7459 | hits on page: 40
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for GB77683: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for WZ39505: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for XA86799: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for SU99742: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for ZE87532: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for PT45615: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for JY35599: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for MG41395: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for DN18269: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for WK49951: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for HG95875: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for SV54413: 0
2026-03-30 07:34:09 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-30 07:34:09 [auto1.de] INFO: Scrape type for CL13866: 0
2026-03-30 07:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:10 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 7460 | hits on page: 40
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for CL13866: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for BY81957: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for NJ51378: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for DM11182: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for EX39495: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for UF75132: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for EK64818: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for YW90897: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for JG12226: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for VM39350: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for CZ09643: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for LZ98247: 0
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 07:34:10 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-30 07:34:10 [auto1.de] INFO: Scrape type for LV79824: 0
2026-03-30 07:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:11 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 7462 | hits on page: 40
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-30 07:34:11 [auto1.de] INFO: Scrape type for LV79824: 0
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-30 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-30 07:34:11 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 07:34:11 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for MW79047: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for VX94865: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for CZ47065: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for XE08723: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for AU50389: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for KJ28184: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for HY43469: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for UT98357: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for KF75867: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for JA01983: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for AH44309: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for PM99817: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for DB08314: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for DP06637: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for NG65344: 0
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-30 07:34:12 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-30 07:34:12 [auto1.de] INFO: Scrape type for XT30705: 0
2026-03-30 07:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:13 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 7462 | hits on page: 40
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for CL69426: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for WJ52801: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for GV67741: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for SR43778: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for YY88868: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for EU26057: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for RZ45087: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for HW35113: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for TP80753: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for WB48893: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for YK03536: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for EJ19003: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-30 07:34:13 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-30 07:34:13 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 07:34:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:14 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 7463 | hits on page: 40
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-30 07:34:14 [auto1.de] INFO: Scrape type for XL04777: 0
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-30 07:34:14 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-30 07:34:14 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-30 07:34:14 [auto1.de] INFO: Scrape type for BL18853: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for XE49281: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for SY67219: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for AT70381: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for HE00957: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for PJ99813: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-30 07:34:15 [auto1.de] INFO: Scrape type for SR95486: 0
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 07:34:15 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 07:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:16 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 7466 | hits on page: 40
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for SR95486: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for WL45010: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for YP11119: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for MC32966: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for FA50226: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-30 07:34:16 [auto1.de] INFO: Scrape type for YE79096: 0
2026-03-30 07:34:16 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-30 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for XG44569: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for EE17704: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for WT63610: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for MT90206: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for KS19016: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for SH98568: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-30 07:34:17 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-30 07:34:17 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 07:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:22 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 7471 | hits on page: 40
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for GL55365: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for GM39396: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for WJ57335: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for YU84960: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for JT65336: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for BR88683: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for PY66131: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for NH10753: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for PP86111: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for AU99703: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-30 07:34:22 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 07:34:22 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-30 07:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:23 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 7472 | hits on page: 40
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for XJ45397: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for DN40523: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for NR32079: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for PD79431: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for BK28670: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for TB02108: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for GB27698: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for WA11944: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for VA77092: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for LW90225: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for ZA27483: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for XM73112: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-30 07:34:23 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-30 07:34:23 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-30 07:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:25 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 7476 | hits on page: 40
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for RW76455: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for RC29911: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for WC25701: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for RS41901: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for CW57830: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 07:34:25 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-30 07:34:25 [auto1.de] INFO: Scrape type for YV77496: 2
2026-03-30 07:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-30 07:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf17382-e942-5eb8-b7f7-2dbf1531b4ea with scrape type 2
2026-03-30 07:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf17382-e942-5eb8-b7f7-2dbf1531b4ea with scrape type 2
2026-03-30 07:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caf17382-e942-5eb8-b7f7-2dbf1531b4ea, identifier: YV77496
2026-03-30 07:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-30 07:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-30 07:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496 to the API
2026-03-30 07:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:37Z',
 'fuel_type': 'diesel',
 'id': 'caf17382-e942-5eb8-b7f7-2dbf1531b4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV77496',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 160727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2019}
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-30 07:34:26 [auto1.de] INFO: Saving data for YV77496: {'auction_closing_time': 1774885717.0, 'created_time': 1774378048.104266, 'last_price_update_time': 1774856066.1514}
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV77496') HTTP/1.1" 204 0
2026-03-30 07:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:26 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-30 07:34:26 [auto1.de] INFO: Scrape type for UP55946: 2
2026-03-30 07:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-30 07:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-30 07:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-30 07:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de367412-b564-5c37-9ef9-f93836afcfd0, identifier: UP55946
2026-03-30 07:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-30 07:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-30 07:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946 to the API
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:53Z',
 'fuel_type': 'diesel',
 'id': 'de367412-b564-5c37-9ef9-f93836afcfd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP55946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 133255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t Ecoline',
 'transmission': 'manual',
 'trim': 'L1H1 Ka 2,8t Ecoline',
 'year': 2015}
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-30 07:34:26 [auto1.de] INFO: Saving data for UP55946: {'auction_closing_time': 1774883213.0, 'created_time': 1773303063.986486, 'last_price_update_time': 1774856066.668856}
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP55946') HTTP/1.1" 204 0
2026-03-30 07:34:26 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 07:34:26 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-30 07:34:26 [auto1.de] INFO: Scrape type for NJ52204: 2
2026-03-30 07:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-30 07:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with scrape type 2
2026-03-30 07:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with scrape type 2
2026-03-30 07:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f49ffd-f9a0-55b1-9010-c0cd79a41753, identifier: NJ52204
2026-03-30 07:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-30 07:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-30 07:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204 to the API
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:13Z',
 'fuel_type': 'petrol',
 'id': '27f49ffd-f9a0-55b1-9010-c0cd79a41753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ52204',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 128640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-30 07:34:27 [auto1.de] INFO: Saving data for NJ52204: {'auction_closing_time': 1774884133.0, 'created_time': 1773741436.549641, 'last_price_update_time': 1774856067.097123}
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ52204') HTTP/1.1" 204 0
2026-03-30 07:34:27 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 07:34:27 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 07:34:27 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-30 07:34:27 [auto1.de] INFO: Scrape type for CG08693: 2
2026-03-30 07:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-30 07:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd33eac-fed6-589a-a915-8acc63e4c9e5 with scrape type 2
2026-03-30 07:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd33eac-fed6-589a-a915-8acc63e4c9e5 with scrape type 2
2026-03-30 07:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afd33eac-fed6-589a-a915-8acc63e4c9e5, identifier: CG08693
2026-03-30 07:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-30 07:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-30 07:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693 to the API
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:15:25Z',
 'fuel_type': 'diesel',
 'id': 'afd33eac-fed6-589a-a915-8acc63e4c9e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG08693',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 78759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2020}
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-30 07:34:27 [auto1.de] INFO: Saving data for CG08693: {'auction_closing_time': 1774883725.0, 'created_time': 1773307411.686237, 'last_price_update_time': 1774856067.53578}
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG08693') HTTP/1.1" 204 0
2026-03-30 07:34:27 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-30 07:34:27 [auto1.de] INFO: Scrape type for YN38539: 2
2026-03-30 07:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-30 07:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-30 07:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-30 07:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7, identifier: YN38539
2026-03-30 07:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 07:34:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-30 07:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539 to the API
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:24Z',
 'fuel_type': 'petrol',
 'id': '47b7bfe3-ae4d-5e64-9d48-b368bc428fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN38539',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Stratus',
 'odometer': 69735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-04-29',
 'seller_name': None,
 'title': 'Chrysler Stratus 2.5 V6 LX',
 'transmission': 'automatic',
 'trim': 'V6 LX',
 'year': 1998}
2026-03-30 07:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-30 07:34:28 [auto1.de] INFO: Saving data for YN38539: {'auction_closing_time': 1774885824.0, 'created_time': 1773228688.002477, 'last_price_update_time': 1774856068.09813}
2026-03-30 07:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN38539') HTTP/1.1" 204 0
2026-03-30 07:34:28 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 07:34:28 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 07:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:44 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 7503 | hits on page: 40
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for YV77496: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-30 07:34:44 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 07:34:44 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-30 07:34:45 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-30 07:34:45 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 07:34:45 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 07:34:45 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Scrape type for LG10256: 2
2026-03-30 07:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-30 07:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd052d56-1ad3-5061-9d0c-b964c314dbad with scrape type 2
2026-03-30 07:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd052d56-1ad3-5061-9d0c-b964c314dbad with scrape type 2
2026-03-30 07:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd052d56-1ad3-5061-9d0c-b964c314dbad, identifier: LG10256
2026-03-30 07:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-30 07:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-30 07:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256 to the API
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:34:06Z',
 'fuel_type': 'petrol',
 'id': 'fd052d56-1ad3-5061-9d0c-b964c314dbad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG10256',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 147978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Saving data for LG10256: {'auction_closing_time': 1774884846.0, 'created_time': 1773830414.578552, 'last_price_update_time': 1774856085.503547}
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG10256') HTTP/1.1" 204 0
2026-03-30 07:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:45 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Scrape type for KK73289: 2
2026-03-30 07:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-30 07:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f5350c-f51b-596d-971e-7f3b349f21ef with scrape type 2
2026-03-30 07:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f5350c-f51b-596d-971e-7f3b349f21ef with scrape type 2
2026-03-30 07:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5f5350c-f51b-596d-971e-7f3b349f21ef, identifier: KK73289
2026-03-30 07:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-30 07:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-30 07:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289 to the API
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 612,
 'expiration_date': '2026-03-30T15:50:58Z',
 'fuel_type': 'petrol',
 'id': 'd5f5350c-f51b-596d-971e-7f3b349f21ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK73289',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 148297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 63 AMG L 4Matic',
 'transmission': 'automatic',
 'trim': 'L 4Matic',
 'year': 2018}
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-30 07:34:45 [auto1.de] INFO: Saving data for KK73289: {'auction_closing_time': 1774885858.0, 'created_time': 1774291935.452467, 'last_price_update_time': 1774856085.992245}
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK73289') HTTP/1.1" 204 0
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-30 07:34:46 [auto1.de] INFO: Scrape type for LS49952: 2
2026-03-30 07:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-30 07:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-30 07:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-30 07:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be26a880-c042-5db3-a95f-1b22f9a4e33d, identifier: LS49952
2026-03-30 07:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-30 07:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-30 07:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952 to the API
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'diesel',
 'id': 'be26a880-c042-5db3-a95f-1b22f9a4e33d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS49952',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 144757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-24',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-30 07:34:46 [auto1.de] INFO: Saving data for LS49952: {'auction_closing_time': 1774883836.0, 'created_time': 1773307326.541621, 'last_price_update_time': 1774856086.454597}
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS49952') HTTP/1.1" 204 0
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-30 07:34:46 [auto1.de] INFO: Scrape type for EN74445: 2
2026-03-30 07:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-30 07:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-30 07:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-30 07:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82, identifier: EN74445
2026-03-30 07:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-30 07:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-30 07:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445 to the API
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:37:29Z',
 'fuel_type': 'diesel',
 'id': 'f06bf916-8ec8-5711-b2a5-0d9f6da2dd82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN74445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 117852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-30 07:34:46 [auto1.de] INFO: Saving data for EN74445: {'auction_closing_time': 1774885049.0, 'created_time': 1773225163.627787, 'last_price_update_time': 1774856086.881301}
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN74445') HTTP/1.1" 204 0
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 07:34:46 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-30 07:34:46 [auto1.de] INFO: Scrape type for NC06801: 2
2026-03-30 07:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-30 07:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-30 07:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-30 07:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97036840-b34f-5d4b-8251-e5a327b3ad4f, identifier: NC06801
2026-03-30 07:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-30 07:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-30 07:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801 to the API
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:00Z',
 'fuel_type': 'petrol',
 'id': '97036840-b34f-5d4b-8251-e5a327b3ad4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC06801',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 129074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-05',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2014}
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-30 07:34:47 [auto1.de] INFO: Saving data for NC06801: {'auction_closing_time': 1774883220.0, 'created_time': 1773228965.411348, 'last_price_update_time': 1774856087.30188}
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC06801') HTTP/1.1" 204 0
2026-03-30 07:34:47 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-30 07:34:47 [auto1.de] INFO: Scrape type for YL95361: 2
2026-03-30 07:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-30 07:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with scrape type 2
2026-03-30 07:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with scrape type 2
2026-03-30 07:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f, identifier: YL95361
2026-03-30 07:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-30 07:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-30 07:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361 to the API
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'diesel',
 'id': 'e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL95361',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 100009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang 4Motion',
 'transmission': 'automatic',
 'trim': 'lang 4Motion',
 'year': 2017}
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-30 07:34:47 [auto1.de] INFO: Saving data for YL95361: {'auction_closing_time': 1774885368.0, 'created_time': 1774377998.661065, 'last_price_update_time': 1774856087.728642}
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL95361') HTTP/1.1" 204 0
2026-03-30 07:34:47 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-30 07:34:47 [auto1.de] INFO: Scrape type for DZ61875: 2
2026-03-30 07:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-30 07:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df38646-7b80-5690-bdfc-b933801c0246 with scrape type 2
2026-03-30 07:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4df38646-7b80-5690-bdfc-b933801c0246 with scrape type 2
2026-03-30 07:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4df38646-7b80-5690-bdfc-b933801c0246, identifier: DZ61875
2026-03-30 07:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-30 07:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-30 07:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875 to the API
2026-03-30 07:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:49Z',
 'fuel_type': 'diesel',
 'id': '4df38646-7b80-5690-bdfc-b933801c0246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ61875',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 99983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency 2Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency 2Style',
 'year': 2014}
2026-03-30 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-30 07:34:48 [auto1.de] INFO: Saving data for DZ61875: {'auction_closing_time': 1774884889.0, 'created_time': 1773302969.669954, 'last_price_update_time': 1774856088.153546}
2026-03-30 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ61875') HTTP/1.1" 204 0
2026-03-30 07:34:48 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 07:34:48 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 07:34:48 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 07:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:52 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 7518 | hits on page: 40
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for SF55933: 2
2026-03-30 07:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-30 07:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f444f1-b6ae-5dd8-943f-49917b36f542 with scrape type 2
2026-03-30 07:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f444f1-b6ae-5dd8-943f-49917b36f542 with scrape type 2
2026-03-30 07:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4f444f1-b6ae-5dd8-943f-49917b36f542, identifier: SF55933
2026-03-30 07:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-30 07:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-30 07:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933 to the API
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:06:03Z',
 'fuel_type': 'diesel',
 'id': 'd4f444f1-b6ae-5dd8-943f-49917b36f542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF55933',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 123247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Saving data for SF55933: {'auction_closing_time': 1774883163.0, 'created_time': 1773135783.408842, 'last_price_update_time': 1774856092.607029}
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF55933') HTTP/1.1" 204 0
2026-03-30 07:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:52 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-30 07:34:52 [auto1.de] INFO: Scrape type for RY86630: 2
2026-03-30 07:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-30 07:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb0120e-2904-5495-8568-4f718e1ac06c with scrape type 2
2026-03-30 07:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb0120e-2904-5495-8568-4f718e1ac06c with scrape type 2
2026-03-30 07:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb0120e-2904-5495-8568-4f718e1ac06c, identifier: RY86630
2026-03-30 07:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-30 07:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-30 07:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630 to the API
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:30Z',
 'fuel_type': 'diesel',
 'id': '1bb0120e-2904-5495-8568-4f718e1ac06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY86630',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 119503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-30 07:34:53 [auto1.de] INFO: Saving data for RY86630: {'auction_closing_time': 1774884510.0, 'created_time': 1773229651.733172, 'last_price_update_time': 1774856093.41137}
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY86630') HTTP/1.1" 204 0
2026-03-30 07:34:53 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-30 07:34:53 [auto1.de] INFO: Scrape type for CU91826: 2
2026-03-30 07:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-30 07:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2603cd-d54b-52b7-ac4c-22502a862bd2 with scrape type 2
2026-03-30 07:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef2603cd-d54b-52b7-ac4c-22502a862bd2 with scrape type 2
2026-03-30 07:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef2603cd-d54b-52b7-ac4c-22502a862bd2, identifier: CU91826
2026-03-30 07:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-30 07:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-30 07:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826 to the API
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:15Z',
 'fuel_type': 'diesel',
 'id': 'ef2603cd-d54b-52b7-ac4c-22502a862bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU91826',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 167349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-30 07:34:53 [auto1.de] INFO: Saving data for CU91826: {'auction_closing_time': 1774883355.0, 'created_time': 1773830793.207047, 'last_price_update_time': 1774856093.910175}
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU91826') HTTP/1.1" 204 0
2026-03-30 07:34:53 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 07:34:53 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 07:34:53 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-30 07:34:53 [auto1.de] INFO: Scrape type for YY17846: 2
2026-03-30 07:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-30 07:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082efb13-27db-5a4b-9dfc-f34bc1847156 with scrape type 2
2026-03-30 07:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082efb13-27db-5a4b-9dfc-f34bc1847156 with scrape type 2
2026-03-30 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 082efb13-27db-5a4b-9dfc-f34bc1847156, identifier: YY17846
2026-03-30 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-30 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-30 07:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846 to the API
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'diesel',
 'id': '082efb13-27db-5a4b-9dfc-f34bc1847156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY17846',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 80715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2015}
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-30 07:34:54 [auto1.de] INFO: Saving data for YY17846: {'auction_closing_time': 1774884566.0, 'created_time': 1773229136.910689, 'last_price_update_time': 1774856094.421528}
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY17846') HTTP/1.1" 204 0
2026-03-30 07:34:54 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 07:34:54 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 07:34:54 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 07:34:54 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-30 07:34:54 [auto1.de] INFO: Scrape type for CG73719: 2
2026-03-30 07:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-30 07:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e708035-a7f3-56ca-9400-b525d0518c74 with scrape type 2
2026-03-30 07:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e708035-a7f3-56ca-9400-b525d0518c74 with scrape type 2
2026-03-30 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e708035-a7f3-56ca-9400-b525d0518c74, identifier: CG73719
2026-03-30 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-30 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-30 07:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719 to the API
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:45Z',
 'fuel_type': 'petrol',
 'id': '2e708035-a7f3-56ca-9400-b525d0518c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG73719',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 49535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-12',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-30 07:34:54 [auto1.de] INFO: Saving data for CG73719: {'auction_closing_time': 1774883205.0, 'created_time': 1773224876.898418, 'last_price_update_time': 1774856094.846647}
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG73719') HTTP/1.1" 204 0
2026-03-30 07:34:54 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-30 07:34:54 [auto1.de] INFO: Scrape type for NB79280: 2
2026-03-30 07:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-30 07:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce20d58-9340-5ced-afa2-899cad433423 with scrape type 2
2026-03-30 07:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ce20d58-9340-5ced-afa2-899cad433423 with scrape type 2
2026-03-30 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ce20d58-9340-5ced-afa2-899cad433423, identifier: NB79280
2026-03-30 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-30 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-30 07:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280 to the API
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:52:50Z',
 'fuel_type': 'petrol',
 'id': '8ce20d58-9340-5ced-afa2-899cad433423',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB79280',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5 Sportback',
 'odometer': 143552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-15',
 'seller_name': None,
 'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-30 07:34:55 [auto1.de] INFO: Saving data for NB79280: {'auction_closing_time': 1774885970.0, 'created_time': 1773830423.296158, 'last_price_update_time': 1774856095.255131}
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB79280') HTTP/1.1" 204 0
2026-03-30 07:34:55 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-30 07:34:55 [auto1.de] INFO: Scrape type for XK62781: 2
2026-03-30 07:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-30 07:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b149f4-2f34-5747-a438-460d91bdcb09 with scrape type 2
2026-03-30 07:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b149f4-2f34-5747-a438-460d91bdcb09 with scrape type 2
2026-03-30 07:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b149f4-2f34-5747-a438-460d91bdcb09, identifier: XK62781
2026-03-30 07:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-30 07:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-30 07:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781 to the API
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'diesel',
 'id': '50b149f4-2f34-5747-a438-460d91bdcb09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK62781',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 52451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-17',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2017}
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-30 07:34:55 [auto1.de] INFO: Saving data for XK62781: {'auction_closing_time': 1774884123.0, 'created_time': 1773227599.830867, 'last_price_update_time': 1774856095.679932}
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK62781') HTTP/1.1" 204 0
2026-03-30 07:34:55 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-30 07:34:55 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-30 07:34:55 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-30 07:34:55 [auto1.de] INFO: Scrape type for YF68653: 2
2026-03-30 07:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-30 07:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b758e719-b895-55ce-a668-59666ee125af with scrape type 2
2026-03-30 07:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b758e719-b895-55ce-a668-59666ee125af with scrape type 2
2026-03-30 07:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b758e719-b895-55ce-a668-59666ee125af, identifier: YF68653
2026-03-30 07:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-30 07:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-30 07:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653 to the API
2026-03-30 07:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:47:18Z',
 'fuel_type': 'hybrid',
 'id': 'b758e719-b895-55ce-a668-59666ee125af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF68653',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 24490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-30 07:34:56 [auto1.de] INFO: Saving data for YF68653: {'auction_closing_time': 1774885638.0, 'created_time': 1773228278.83062, 'last_price_update_time': 1774856096.178889}
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF68653') HTTP/1.1" 204 0
2026-03-30 07:34:56 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-30 07:34:56 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-30 07:34:56 [auto1.de] INFO: Scrape type for TF22102: 2
2026-03-30 07:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-30 07:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19136e81-3df1-5e27-9a41-d0b687c90d68 with scrape type 2
2026-03-30 07:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19136e81-3df1-5e27-9a41-d0b687c90d68 with scrape type 2
2026-03-30 07:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19136e81-3df1-5e27-9a41-d0b687c90d68, identifier: TF22102
2026-03-30 07:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-30 07:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-30 07:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102 to the API
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:57Z',
 'fuel_type': 'diesel',
 'id': '19136e81-3df1-5e27-9a41-d0b687c90d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF22102',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 89956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2019}
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-30 07:34:56 [auto1.de] INFO: Saving data for TF22102: {'auction_closing_time': 1774882857.0, 'created_time': 1774291800.037167, 'last_price_update_time': 1774856096.593054}
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF22102') HTTP/1.1" 204 0
2026-03-30 07:34:56 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-30 07:34:56 [auto1.de] INFO: Scrape type for FG94497: 2
2026-03-30 07:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-30 07:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-30 07:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-30 07:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e, identifier: FG94497
2026-03-30 07:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-30 07:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-30 07:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497 to the API
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:34:40Z',
 'fuel_type': 'diesel',
 'id': 'b7c6980b-7cb1-5b6f-846e-03dca8c11a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG94497',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 311006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-01',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-30 07:34:57 [auto1.de] INFO: Saving data for FG94497: {'auction_closing_time': 1774884880.0, 'created_time': 1773226162.563917, 'last_price_update_time': 1774856097.02767}
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG94497') HTTP/1.1" 204 0
2026-03-30 07:34:57 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-30 07:34:57 [auto1.de] INFO: Scrape type for HE99483: 2
2026-03-30 07:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-30 07:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a849d2c-bac0-5add-9427-cfdedd37481f with scrape type 2
2026-03-30 07:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a849d2c-bac0-5add-9427-cfdedd37481f with scrape type 2
2026-03-30 07:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a849d2c-bac0-5add-9427-cfdedd37481f, identifier: HE99483
2026-03-30 07:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-30 07:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-30 07:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483 to the API
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:35Z',
 'fuel_type': 'diesel',
 'id': '9a849d2c-bac0-5add-9427-cfdedd37481f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE99483',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 301933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2014}
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-30 07:34:57 [auto1.de] INFO: Saving data for HE99483: {'auction_closing_time': 1774884275.0, 'created_time': 1773741534.076461, 'last_price_update_time': 1774856097.436137}
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE99483') HTTP/1.1" 204 0
2026-03-30 07:34:57 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-30 07:34:57 [auto1.de] INFO: Scrape type for LF77567: 2
2026-03-30 07:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-30 07:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28314ce-1222-5e51-b084-9b8d74ca8aa7 with scrape type 2
2026-03-30 07:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f28314ce-1222-5e51-b084-9b8d74ca8aa7 with scrape type 2
2026-03-30 07:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f28314ce-1222-5e51-b084-9b8d74ca8aa7, identifier: LF77567
2026-03-30 07:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-30 07:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-30 07:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567 to the API
2026-03-30 07:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:27:55Z',
 'fuel_type': 'diesel',
 'id': 'f28314ce-1222-5e51-b084-9b8d74ca8aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF77567',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 132150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-30 07:34:58 [auto1.de] INFO: Saving data for LF77567: {'auction_closing_time': 1774884475.0, 'created_time': 1773229840.977069, 'last_price_update_time': 1774856098.464546}
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF77567') HTTP/1.1" 204 0
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 07:34:58 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 7521 | hits on page: 40
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-30 07:34:58 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-30 07:34:58 [auto1.de] INFO: Scrape type for LF77567: 0
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-30 07:34:58 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-30 07:34:58 [auto1.de] INFO: Scrape type for VJ93938: 2
2026-03-30 07:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-30 07:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 725c8336-0865-56b5-8774-4f334b23b962 with scrape type 2
2026-03-30 07:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 725c8336-0865-56b5-8774-4f334b23b962 with scrape type 2
2026-03-30 07:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 725c8336-0865-56b5-8774-4f334b23b962, identifier: VJ93938
2026-03-30 07:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-30 07:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-30 07:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938 to the API
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:24:24Z',
 'fuel_type': 'diesel',
 'id': '725c8336-0865-56b5-8774-4f334b23b962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ93938',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 74795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-30 07:34:58 [auto1.de] INFO: Saving data for VJ93938: {'auction_closing_time': 1774884264.0, 'created_time': 1774465753.855338, 'last_price_update_time': 1774856098.928902}
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ93938') HTTP/1.1" 204 0
2026-03-30 07:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:34:59 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-30 07:34:59 [auto1.de] INFO: Scrape type for AX13429: 2
2026-03-30 07:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-30 07:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd6c8799-a6ee-570d-842e-087d03a9198c with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd6c8799-a6ee-570d-842e-087d03a9198c with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd6c8799-a6ee-570d-842e-087d03a9198c, identifier: AX13429
2026-03-30 07:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-30 07:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-30 07:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429 to the API
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:15:41Z',
 'fuel_type': 'petrol',
 'id': 'cd6c8799-a6ee-570d-842e-087d03a9198c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX13429',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 115559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Tourer Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-30 07:34:59 [auto1.de] INFO: Saving data for AX13429: {'auction_closing_time': 1774883741.0, 'created_time': 1773229337.51476, 'last_price_update_time': 1774856099.429384}
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX13429') HTTP/1.1" 204 0
2026-03-30 07:34:59 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-30 07:34:59 [auto1.de] INFO: Scrape type for SD17030: 2
2026-03-30 07:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-30 07:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4dffae0-9883-5211-97e0-5506499f7ade, identifier: SD17030
2026-03-30 07:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-30 07:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-30 07:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030 to the API
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:11:36Z',
 'fuel_type': 'petrol',
 'id': 'b4dffae0-9883-5211-97e0-5506499f7ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD17030',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 100374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-30 07:34:59 [auto1.de] INFO: Saving data for SD17030: {'auction_closing_time': 1774883496.0, 'created_time': 1773227290.29476, 'last_price_update_time': 1774856099.850558}
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD17030') HTTP/1.1" 204 0
2026-03-30 07:34:59 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 07:34:59 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-30 07:34:59 [auto1.de] INFO: Scrape type for NH81971: 2
2026-03-30 07:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-30 07:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-30 07:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d500038-8bc4-5523-abeb-64df60507f7f, identifier: NH81971
2026-03-30 07:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-30 07:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-30 07:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971 to the API
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:04Z',
 'fuel_type': 'petrol',
 'id': '8d500038-8bc4-5523-abeb-64df60507f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH81971',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 127680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-30 07:35:00 [auto1.de] INFO: Saving data for NH81971: {'auction_closing_time': 1774885264.0, 'created_time': 1773341410.983319, 'last_price_update_time': 1774856100.307528}
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH81971') HTTP/1.1" 204 0
2026-03-30 07:35:00 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-30 07:35:00 [auto1.de] INFO: Scrape type for JF12446: 2
2026-03-30 07:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-30 07:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-30 07:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-30 07:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e14b3722-6251-5e9d-9634-9e562d472e6d, identifier: JF12446
2026-03-30 07:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-30 07:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-30 07:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446 to the API
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:33Z',
 'fuel_type': 'petrol',
 'id': 'e14b3722-6251-5e9d-9634-9e562d472e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF12446',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 111161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Nissan Note 1.6 I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2012}
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-30 07:35:00 [auto1.de] INFO: Saving data for JF12446: {'auction_closing_time': 1774882953.0, 'created_time': 1773341018.13113, 'last_price_update_time': 1774856100.71897}
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF12446') HTTP/1.1" 204 0
2026-03-30 07:35:00 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-30 07:35:00 [auto1.de] INFO: Scrape type for PU44230: 2
2026-03-30 07:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-30 07:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb05dc70-bc51-555c-8008-ce6b1cde573b with scrape type 2
2026-03-30 07:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb05dc70-bc51-555c-8008-ce6b1cde573b with scrape type 2
2026-03-30 07:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb05dc70-bc51-555c-8008-ce6b1cde573b, identifier: PU44230
2026-03-30 07:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-30 07:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-30 07:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230 to the API
2026-03-30 07:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-30T15:00:08Z',
 'fuel_type': 'petrol',
 'id': 'cb05dc70-bc51-555c-8008-ce6b1cde573b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU44230',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 56560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2020}
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-30 07:35:01 [auto1.de] INFO: Saving data for PU44230: {'auction_closing_time': 1774882808.0, 'created_time': 1773228552.677823, 'last_price_update_time': 1774856101.175853}
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU44230') HTTP/1.1" 204 0
2026-03-30 07:35:01 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-30 07:35:01 [auto1.de] INFO: Scrape type for ER86835: 2
2026-03-30 07:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-30 07:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with scrape type 2
2026-03-30 07:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with scrape type 2
2026-03-30 07:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f58e1a5-a918-54fb-a8b3-a86f6734f286, identifier: ER86835
2026-03-30 07:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-30 07:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-30 07:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835 to the API
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:41:48Z',
 'fuel_type': 'diesel',
 'id': '3f58e1a5-a918-54fb-a8b3-a86f6734f286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER86835',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 352466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2008}
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-30 07:35:01 [auto1.de] INFO: Saving data for ER86835: {'auction_closing_time': 1774885308.0, 'created_time': 1773132206.397327, 'last_price_update_time': 1774856101.630471}
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER86835') HTTP/1.1" 204 0
2026-03-30 07:35:01 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-30 07:35:01 [auto1.de] INFO: Scrape type for MA20018: 2
2026-03-30 07:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-30 07:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a06a219-147b-5967-a9c6-ccd9da789b13 with scrape type 2
2026-03-30 07:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a06a219-147b-5967-a9c6-ccd9da789b13 with scrape type 2
2026-03-30 07:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a06a219-147b-5967-a9c6-ccd9da789b13, identifier: MA20018
2026-03-30 07:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-30 07:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-30 07:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018 to the API
2026-03-30 07:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:37:52Z',
 'fuel_type': 'petrol',
 'id': '8a06a219-147b-5967-a9c6-ccd9da789b13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA20018',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 79157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-30 07:35:02 [auto1.de] INFO: Saving data for MA20018: {'auction_closing_time': 1774885072.0, 'created_time': 1773343854.910449, 'last_price_update_time': 1774856102.194407}
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA20018') HTTP/1.1" 204 0
2026-03-30 07:35:02 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-30 07:35:02 [auto1.de] INFO: Scrape type for SU19428: 2
2026-03-30 07:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-30 07:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with scrape type 2
2026-03-30 07:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with scrape type 2
2026-03-30 07:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ab60f7-e878-506e-bc81-c8759dc0e5a4, identifier: SU19428
2026-03-30 07:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-30 07:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-30 07:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428 to the API
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:17Z',
 'fuel_type': 'diesel',
 'id': '26ab60f7-e878-506e-bc81-c8759dc0e5a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU19428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 291746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2012}
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-30 07:35:02 [auto1.de] INFO: Saving data for SU19428: {'auction_closing_time': 1774885337.0, 'created_time': 1773226588.392887, 'last_price_update_time': 1774856102.717878}
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU19428') HTTP/1.1" 204 0
2026-03-30 07:35:02 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-30 07:35:02 [auto1.de] INFO: Scrape type for UW74525: 2
2026-03-30 07:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-30 07:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f4322f6-c901-5dcf-808a-f9e65a38b913 with scrape type 2
2026-03-30 07:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f4322f6-c901-5dcf-808a-f9e65a38b913 with scrape type 2
2026-03-30 07:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f4322f6-c901-5dcf-808a-f9e65a38b913, identifier: UW74525
2026-03-30 07:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-30 07:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-30 07:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525 to the API
2026-03-30 07:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'petrol',
 'id': '7f4322f6-c901-5dcf-808a-f9e65a38b913',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW74525',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 31408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-11',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-30 07:35:03 [auto1.de] INFO: Saving data for UW74525: {'auction_closing_time': 1774883661.0, 'created_time': 1773305938.614559, 'last_price_update_time': 1774856103.18029}
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW74525') HTTP/1.1" 204 0
2026-03-30 07:35:03 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-30 07:35:03 [auto1.de] INFO: Scrape type for CP06642: 2
2026-03-30 07:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-30 07:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-30 07:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-30 07:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b, identifier: CP06642
2026-03-30 07:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-30 07:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-30 07:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642 to the API
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:21:02Z',
 'fuel_type': 'petrol',
 'id': '14486fe4-9ea4-5ea5-9b46-ebb33e56808b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP06642',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 56773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-30 07:35:03 [auto1.de] INFO: Saving data for CP06642: {'auction_closing_time': 1774884062.0, 'created_time': 1773132241.051774, 'last_price_update_time': 1774856103.606857}
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP06642') HTTP/1.1" 204 0
2026-03-30 07:35:03 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-30 07:35:03 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-30 07:35:03 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-30 07:35:03 [auto1.de] INFO: Scrape type for YX40073: 2
2026-03-30 07:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-30 07:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054c889c-dd10-53ce-8b84-b623175186ec with scrape type 2
2026-03-30 07:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 054c889c-dd10-53ce-8b84-b623175186ec with scrape type 2
2026-03-30 07:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 054c889c-dd10-53ce-8b84-b623175186ec, identifier: YX40073
2026-03-30 07:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-30 07:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-30 07:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073 to the API
2026-03-30 07:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:37:47Z',
 'fuel_type': 'petrol',
 'id': '054c889c-dd10-53ce-8b84-b623175186ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX40073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 74442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2022}
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-30 07:35:04 [auto1.de] INFO: Saving data for YX40073: {'auction_closing_time': 1774885067.0, 'created_time': 1774378012.791862, 'last_price_update_time': 1774856104.111751}
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX40073') HTTP/1.1" 204 0
2026-03-30 07:35:04 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 7529 | hits on page: 40
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-30 07:35:04 [auto1.de] INFO: Scrape type for LC05735: 2
2026-03-30 07:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-30 07:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0088-dc9f-5bc2-be38-cdc35e754cd5, identifier: LC05735
2026-03-30 07:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-30 07:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-30 07:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735 to the API
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:21:31Z',
 'fuel_type': 'petrol',
 'id': '515d0088-dc9f-5bc2-be38-cdc35e754cd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC05735',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 19216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-30 07:35:04 [auto1.de] INFO: Saving data for LC05735: {'auction_closing_time': 1774884091.0, 'created_time': 1773307137.637304, 'last_price_update_time': 1774856104.537474}
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC05735') HTTP/1.1" 204 0
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-30 07:35:04 [auto1.de] INFO: Scrape type for ZT07846: 2
2026-03-30 07:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-30 07:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3, identifier: ZT07846
2026-03-30 07:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:04 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-30 07:35:04 [auto1.de] INFO: Scrape type for VH46900: 2
2026-03-30 07:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-30 07:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3932a8-3cda-518f-8c94-93624cc7581d with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f3932a8-3cda-518f-8c94-93624cc7581d with scrape type 2
2026-03-30 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f3932a8-3cda-518f-8c94-93624cc7581d, identifier: VH46900
2026-03-30 07:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-30 07:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-30 07:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846 to the API
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:30:31Z',
 'fuel_type': 'diesel',
 'id': '74c95dc3-0af5-54b5-ba2d-d654d13de3b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT07846',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 148176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-17',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-30 07:35:05 [auto1.de] INFO: Saving data for ZT07846: {'auction_closing_time': 1774884631.0, 'created_time': 1773859080.24702, 'last_price_update_time': 1774856105.109891}
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT07846') HTTP/1.1" 204 0
2026-03-30 07:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-30 07:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-30 07:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900 to the API
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'petrol',
 'id': '7f3932a8-3cda-518f-8c94-93624cc7581d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH46900',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 278758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2012}
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-30 07:35:05 [auto1.de] INFO: Saving data for VH46900: {'auction_closing_time': 1774884198.0, 'created_time': 1773830503.89148, 'last_price_update_time': 1774856105.443403}
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH46900') HTTP/1.1" 204 0
2026-03-30 07:35:05 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-30 07:35:05 [auto1.de] INFO: Scrape type for WG75781: 2
2026-03-30 07:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-30 07:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-30 07:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-30 07:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f, identifier: WG75781
2026-03-30 07:35:05 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-30 07:35:05 [auto1.de] INFO: Scrape type for FM78793: 2
2026-03-30 07:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-30 07:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2d0916-f1cc-5727-a655-538b5f7c91e5 with scrape type 2
2026-03-30 07:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc2d0916-f1cc-5727-a655-538b5f7c91e5 with scrape type 2
2026-03-30 07:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc2d0916-f1cc-5727-a655-538b5f7c91e5, identifier: FM78793
2026-03-30 07:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-30 07:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-30 07:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781 to the API
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:50Z',
 'fuel_type': 'diesel',
 'id': 'cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG75781',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 41915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-30 07:35:06 [auto1.de] INFO: Saving data for WG75781: {'auction_closing_time': 1774884830.0, 'created_time': 1773344911.66281, 'last_price_update_time': 1774856106.016607}
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG75781') HTTP/1.1" 204 0
2026-03-30 07:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-30 07:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-30 07:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793 to the API
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:11:48Z',
 'fuel_type': 'diesel',
 'id': 'fc2d0916-f1cc-5727-a655-538b5f7c91e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM78793',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 206042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-23',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2014}
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-30 07:35:06 [auto1.de] INFO: Saving data for FM78793: {'auction_closing_time': 1774883508.0, 'created_time': 1773341727.986367, 'last_price_update_time': 1774856106.429928}
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM78793') HTTP/1.1" 204 0
2026-03-30 07:35:06 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 07:35:06 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-30 07:35:06 [auto1.de] INFO: Scrape type for ZR25455: 2
2026-03-30 07:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-30 07:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d378a9-3c59-5868-b88d-026cb56dc9e9 with scrape type 2
2026-03-30 07:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70d378a9-3c59-5868-b88d-026cb56dc9e9 with scrape type 2
2026-03-30 07:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70d378a9-3c59-5868-b88d-026cb56dc9e9, identifier: ZR25455
2026-03-30 07:35:06 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-30 07:35:06 [auto1.de] INFO: Scrape type for AW14620: 2
2026-03-30 07:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-30 07:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92812258-493a-5600-9b11-b697f470484e with scrape type 2
2026-03-30 07:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92812258-493a-5600-9b11-b697f470484e with scrape type 2
2026-03-30 07:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92812258-493a-5600-9b11-b697f470484e, identifier: AW14620
2026-03-30 07:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-30 07:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-30 07:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455 to the API
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 612,
 'expiration_date': '2026-03-30T15:01:24Z',
 'fuel_type': 'petrol',
 'id': '70d378a9-3c59-5868-b88d-026cb56dc9e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR25455',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 94980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 63 AMG S T 4Matic',
 'transmission': 'automatic',
 'trim': 'S T 4Matic',
 'year': 2021}
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-30 07:35:07 [auto1.de] INFO: Saving data for ZR25455: {'auction_closing_time': 1774882884.0, 'created_time': 1773426773.212233, 'last_price_update_time': 1774856107.017582}
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR25455') HTTP/1.1" 204 0
2026-03-30 07:35:07 [scrapy.extensions.logstats] INFO: Crawled 228 pages (at 14 pages/min), scraped 293 items (at 42 items/min)
2026-03-30 07:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-30 07:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-30 07:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620 to the API
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'diesel',
 'id': '92812258-493a-5600-9b11-b697f470484e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW14620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 149382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 111 CDI extralang Pro',
 'transmission': 'automatic',
 'trim': 'extralang Pro',
 'year': 2017}
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-30 07:35:07 [auto1.de] INFO: Saving data for AW14620: {'auction_closing_time': 1774885529.0, 'created_time': 1773830599.147862, 'last_price_update_time': 1774856107.307094}
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW14620') HTTP/1.1" 204 0
2026-03-30 07:35:07 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 07:35:07 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-30 07:35:07 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-30 07:35:07 [auto1.de] INFO: Scrape type for LT54057: 2
2026-03-30 07:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-30 07:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aef8ae9-86a2-5083-ba65-845ba25081ec with scrape type 2
2026-03-30 07:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aef8ae9-86a2-5083-ba65-845ba25081ec with scrape type 2
2026-03-30 07:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aef8ae9-86a2-5083-ba65-845ba25081ec, identifier: LT54057
2026-03-30 07:35:07 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-30 07:35:07 [auto1.de] INFO: Scrape type for ZN75041: 2
2026-03-30 07:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-30 07:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cec837e-326e-5f26-89f3-09ed1d22685c with scrape type 2
2026-03-30 07:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cec837e-326e-5f26-89f3-09ed1d22685c with scrape type 2
2026-03-30 07:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cec837e-326e-5f26-89f3-09ed1d22685c, identifier: ZN75041
2026-03-30 07:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-30 07:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-30 07:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057 to the API
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'diesel',
 'id': '7aef8ae9-86a2-5083-ba65-845ba25081ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT54057',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 68671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-03',
 'seller_name': None,
 'title': 'Audi Q3 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-30 07:35:07 [auto1.de] INFO: Saving data for LT54057: {'auction_closing_time': 1774884844.0, 'created_time': 1773342731.026987, 'last_price_update_time': 1774856107.859569}
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT54057') HTTP/1.1" 204 0
2026-03-30 07:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-30 07:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-30 07:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041 to the API
2026-03-30 07:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:28:47Z',
 'fuel_type': 'diesel',
 'id': '2cec837e-326e-5f26-89f3-09ed1d22685c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN75041',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 127209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-30 07:35:08 [auto1.de] INFO: Saving data for ZN75041: {'auction_closing_time': 1774884527.0, 'created_time': 1773662009.355638, 'last_price_update_time': 1774856108.202109}
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN75041') HTTP/1.1" 204 0
2026-03-30 07:35:08 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-30 07:35:08 [auto1.de] INFO: Scrape type for VY54552: 2
2026-03-30 07:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-30 07:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-30 07:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-30 07:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7881bd4-c71c-5250-8725-b543f5a04d69, identifier: VY54552
2026-03-30 07:35:08 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-30 07:35:08 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-30 07:35:08 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-30 07:35:08 [auto1.de] INFO: Scrape type for UW93361: 2
2026-03-30 07:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-30 07:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94680422-3daf-51e2-a6cb-f7799eb90af6 with scrape type 2
2026-03-30 07:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94680422-3daf-51e2-a6cb-f7799eb90af6 with scrape type 2
2026-03-30 07:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94680422-3daf-51e2-a6cb-f7799eb90af6, identifier: UW93361
2026-03-30 07:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-30 07:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-30 07:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552 to the API
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:21:59Z',
 'fuel_type': 'hybrid',
 'id': 'e7881bd4-c71c-5250-8725-b543f5a04d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY54552',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 66959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-30 07:35:08 [auto1.de] INFO: Saving data for VY54552: {'auction_closing_time': 1774884119.0, 'created_time': 1773305616.558535, 'last_price_update_time': 1774856108.720152}
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY54552') HTTP/1.1" 204 0
2026-03-30 07:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-30 07:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-30 07:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361 to the API
2026-03-30 07:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'diesel',
 'id': '94680422-3daf-51e2-a6cb-f7799eb90af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW93361',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 225754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-30 07:35:09 [auto1.de] INFO: Saving data for UW93361: {'auction_closing_time': 1774884205.0, 'created_time': 1773138098.164829, 'last_price_update_time': 1774856109.122851}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW93361') HTTP/1.1" 204 0
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-30 07:35:09 [auto1.de] INFO: Scrape type for GJ78269: 2
2026-03-30 07:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-30 07:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4da8f8c-017c-5601-8d1c-1542e1aed70f with scrape type 2
2026-03-30 07:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4da8f8c-017c-5601-8d1c-1542e1aed70f with scrape type 2
2026-03-30 07:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4da8f8c-017c-5601-8d1c-1542e1aed70f, identifier: GJ78269
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-30 07:35:09 [auto1.de] INFO: Scrape type for YY00897: 2
2026-03-30 07:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-30 07:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with scrape type 2
2026-03-30 07:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with scrape type 2
2026-03-30 07:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce, identifier: YY00897
2026-03-30 07:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-30 07:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-30 07:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269 to the API
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 550,
 'expiration_date': '2026-03-30T15:27:43Z',
 'fuel_type': 'petrol',
 'id': 'f4da8f8c-017c-5601-8d1c-1542e1aed70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ78269',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 186344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': None,
 'title': 'Porsche Cayenne Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-30 07:35:09 [auto1.de] INFO: Saving data for GJ78269: {'auction_closing_time': 1774884463.0, 'created_time': 1773467484.212788, 'last_price_update_time': 1774856109.652632}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ78269') HTTP/1.1" 204 0
2026-03-30 07:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-30 07:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-30 07:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897 to the API
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:33:49Z',
 'fuel_type': 'petrol',
 'id': 'e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY00897',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 146995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-30 07:35:09 [auto1.de] INFO: Saving data for YY00897: {'auction_closing_time': 1774884829.0, 'created_time': 1773830757.23125, 'last_price_update_time': 1774856109.961724}
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY00897') HTTP/1.1" 204 0
2026-03-30 07:35:09 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Scrape type for HW71141: 2
2026-03-30 07:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-30 07:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93732eb-d180-5f0d-b1c8-ee587ec97272, identifier: HW71141
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Scrape type for DE21080: 2
2026-03-30 07:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-30 07:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dc142c-330f-560a-ae67-167ed8230068 with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dc142c-330f-560a-ae67-167ed8230068 with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20dc142c-330f-560a-ae67-167ed8230068, identifier: DE21080
2026-03-30 07:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-30 07:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-30 07:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141 to the API
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:19:25Z',
 'fuel_type': 'petrol',
 'id': 'e93732eb-d180-5f0d-b1c8-ee587ec97272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW71141',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 225463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2009}
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Saving data for HW71141: {'auction_closing_time': 1774883965.0, 'created_time': 1773303892.458719, 'last_price_update_time': 1774856110.489893}
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW71141') HTTP/1.1" 204 0
2026-03-30 07:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-30 07:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-30 07:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080 to the API
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:24:36Z',
 'fuel_type': 'petrol',
 'id': '20dc142c-330f-560a-ae67-167ed8230068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE21080',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 48184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Saving data for DE21080: {'auction_closing_time': 1774884276.0, 'created_time': 1773227400.565206, 'last_price_update_time': 1774856110.790152}
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE21080') HTTP/1.1" 204 0
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Scrape type for EM69554: 2
2026-03-30 07:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-30 07:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e, identifier: EM69554
2026-03-30 07:35:10 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-30 07:35:10 [auto1.de] INFO: Scrape type for ZP65093: 2
2026-03-30 07:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-30 07:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-30 07:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-30 07:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a02073-424e-5eb9-bbb7-bb8bd0142eba, identifier: ZP65093
2026-03-30 07:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-30 07:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-30 07:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554 to the API
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:03:16Z',
 'fuel_type': 'petrol',
 'id': '84b7ba83-b1ef-583f-a99b-c4dab9b3c21e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM69554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 176440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-26',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-30 07:35:11 [auto1.de] INFO: Saving data for EM69554: {'auction_closing_time': 1774882996.0, 'created_time': 1773229236.068166, 'last_price_update_time': 1774856111.586917}
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM69554') HTTP/1.1" 204 0
2026-03-30 07:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-30 07:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-30 07:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093 to the API
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'petrol',
 'id': '40a02073-424e-5eb9-bbb7-bb8bd0142eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP65093',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 156109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2013}
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-30 07:35:11 [auto1.de] INFO: Saving data for ZP65093: {'auction_closing_time': 1774885312.0, 'created_time': 1773227525.60467, 'last_price_update_time': 1774856111.997196}
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP65093') HTTP/1.1" 204 0
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Scrape type for EU39655: 2
2026-03-30 07:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-30 07:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd, identifier: EU39655
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Scrape type for JN49232: 2
2026-03-30 07:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-30 07:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9811c288-0d36-5230-891e-e6522355b169 with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9811c288-0d36-5230-891e-e6522355b169 with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9811c288-0d36-5230-891e-e6522355b169, identifier: JN49232
2026-03-30 07:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-30 07:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-30 07:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655 to the API
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:45:49Z',
 'fuel_type': 'diesel',
 'id': '339546c0-fb26-5a45-b3aa-cb4dd03d97bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU39655',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 179892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-14',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Saving data for EU39655: {'auction_closing_time': 1774885549.0, 'created_time': 1773830439.554433, 'last_price_update_time': 1774856112.534322}
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU39655') HTTP/1.1" 204 0
2026-03-30 07:35:12 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 7538 | hits on page: 40
2026-03-30 07:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-30 07:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-30 07:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232 to the API
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:58Z',
 'fuel_type': 'diesel',
 'id': '9811c288-0d36-5230-891e-e6522355b169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN49232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 119768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'BMW 1er 120d Metropolitan',
 'transmission': 'manual',
 'trim': 'Metropolitan',
 'year': 2019}
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Saving data for JN49232: {'auction_closing_time': 1774885798.0, 'created_time': 1773305499.655783, 'last_price_update_time': 1774856112.850863}
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN49232') HTTP/1.1" 204 0
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Scrape type for RV72867: 2
2026-03-30 07:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-30 07:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69246b1-c72f-5cdd-a792-f25834853c90 with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69246b1-c72f-5cdd-a792-f25834853c90 with scrape type 2
2026-03-30 07:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69246b1-c72f-5cdd-a792-f25834853c90, identifier: RV72867
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-30 07:35:12 [auto1.de] INFO: Scrape type for ZT07846: 0
2026-03-30 07:35:12 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 07:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-30 07:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-30 07:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867 to the API
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:39:13Z',
 'fuel_type': 'diesel',
 'id': 'c69246b1-c72f-5cdd-a792-f25834853c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV72867',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 333127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 kurzer Radstand',
 'transmission': 'manual',
 'trim': 'Kasten 35 kurzer Radstand',
 'year': 2015}
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Saving data for RV72867: {'auction_closing_time': 1774885153.0, 'created_time': 1772729110.013853, 'last_price_update_time': 1774856113.324154}
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV72867') HTTP/1.1" 204 0
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Scrape type for ZK08136: 2
2026-03-30 07:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-30 07:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with scrape type 2
2026-03-30 07:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with scrape type 2
2026-03-30 07:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b, identifier: ZK08136
2026-03-30 07:35:13 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Scrape type for TX59054: 2
2026-03-30 07:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-30 07:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with scrape type 2
2026-03-30 07:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with scrape type 2
2026-03-30 07:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105, identifier: TX59054
2026-03-30 07:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-30 07:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-30 07:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136 to the API
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'petrol',
 'id': '4f69c0ca-4e12-5d01-94fa-2278c4f64e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK08136',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 50211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-30 07:35:13 [auto1.de] INFO: Saving data for ZK08136: {'auction_closing_time': 1774882815.0, 'created_time': 1774769477.361849, 'last_price_update_time': 1774856113.918981}
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK08136') HTTP/1.1" 204 0
2026-03-30 07:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-30 07:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-30 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054 to the API
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:12Z',
 'fuel_type': 'diesel',
 'id': '6c78a9d0-7d1b-5436-a1fc-bdf3bd400105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX59054',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 108114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach',
 'transmission': 'manual',
 'trim': 'Beach',
 'year': 2019}
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-30 07:35:14 [auto1.de] INFO: Saving data for TX59054: {'auction_closing_time': 1774886052.0, 'created_time': 1773306475.897774, 'last_price_update_time': 1774856114.210894}
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX59054') HTTP/1.1" 204 0
2026-03-30 07:35:14 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 07:35:14 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-30 07:35:14 [auto1.de] INFO: Scrape type for VS05622: 2
2026-03-30 07:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-30 07:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a840542-4077-5a10-87ff-48b220ddf332 with scrape type 2
2026-03-30 07:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a840542-4077-5a10-87ff-48b220ddf332 with scrape type 2
2026-03-30 07:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a840542-4077-5a10-87ff-48b220ddf332, identifier: VS05622
2026-03-30 07:35:14 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-30 07:35:14 [auto1.de] INFO: Scrape type for XT69734: 2
2026-03-30 07:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-30 07:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with scrape type 2
2026-03-30 07:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with scrape type 2
2026-03-30 07:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9293e556-446b-55c8-bb14-ee9a6e17a8a9, identifier: XT69734
2026-03-30 07:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-30 07:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-30 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622 to the API
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 281,
 'expiration_date': '2026-03-30T15:57:10Z',
 'fuel_type': 'petrol',
 'id': '5a840542-4077-5a10-87ff-48b220ddf332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS05622',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 19548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-30 07:35:14 [auto1.de] INFO: Saving data for VS05622: {'auction_closing_time': 1774886230.0, 'created_time': 1772544495.799362, 'last_price_update_time': 1774856114.743079}
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS05622') HTTP/1.1" 204 0
2026-03-30 07:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-30 07:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-30 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734 to the API
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:07Z',
 'fuel_type': 'diesel',
 'id': '9293e556-446b-55c8-bb14-ee9a6e17a8a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT69734',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 49878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-27',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Saving data for XT69734: {'auction_closing_time': 1774884847.0, 'created_time': 1774378031.921602, 'last_price_update_time': 1774856115.054205}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT69734') HTTP/1.1" 204 0
2026-03-30 07:35:15 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Scrape type for CU27746: 2
2026-03-30 07:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-30 07:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27, identifier: CU27746
2026-03-30 07:35:15 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 07:35:15 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Scrape type for UP89204: 2
2026-03-30 07:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-30 07:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98645f04-9597-5f2a-8753-b69d88860c26 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98645f04-9597-5f2a-8753-b69d88860c26 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98645f04-9597-5f2a-8753-b69d88860c26, identifier: UP89204
2026-03-30 07:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-30 07:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-30 07:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746 to the API
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:22Z',
 'fuel_type': 'petrol',
 'id': '3e3dc7ee-5ff9-58e5-9852-a905648d4a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU27746',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 50920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-09',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Saving data for CU27746: {'auction_closing_time': 1774886242.0, 'created_time': 1773302561.97334, 'last_price_update_time': 1774856115.564632}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU27746') HTTP/1.1" 204 0
2026-03-30 07:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-30 07:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-30 07:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204 to the API
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:37:16Z',
 'fuel_type': 'petrol',
 'id': '98645f04-9597-5f2a-8753-b69d88860c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP89204',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 160158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'BMW 5er 540i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Saving data for UP89204: {'auction_closing_time': 1774885036.0, 'created_time': 1774769476.927756, 'last_price_update_time': 1774856115.851703}
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP89204') HTTP/1.1" 204 0
2026-03-30 07:35:15 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-30 07:35:15 [auto1.de] INFO: Scrape type for UN73859: 2
2026-03-30 07:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-30 07:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-30 07:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a426c313-2e75-5a1b-8f7d-c6468b298c26, identifier: UN73859
2026-03-30 07:35:15 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-30 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-30 07:35:16 [auto1.de] INFO: Scrape type for TZ11746: 2
2026-03-30 07:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-30 07:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with scrape type 2
2026-03-30 07:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with scrape type 2
2026-03-30 07:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2, identifier: TZ11746
2026-03-30 07:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-30 07:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-30 07:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859 to the API
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:03Z',
 'fuel_type': 'petrol',
 'id': 'a426c313-2e75-5a1b-8f7d-c6468b298c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN73859',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 53357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-27',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-30 07:35:16 [auto1.de] INFO: Saving data for UN73859: {'auction_closing_time': 1774885323.0, 'created_time': 1773226787.943211, 'last_price_update_time': 1774856116.463898}
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN73859') HTTP/1.1" 204 0
2026-03-30 07:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-30 07:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-30 07:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746 to the API
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'petrol',
 'id': 'da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ11746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 30357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-25',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2025}
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-30 07:35:16 [auto1.de] INFO: Saving data for TZ11746: {'auction_closing_time': 1774882891.0, 'created_time': 1773307080.671369, 'last_price_update_time': 1774856116.927317}
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ11746') HTTP/1.1" 204 0
2026-03-30 07:35:16 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-30 07:35:16 [auto1.de] INFO: Scrape type for VG22194: 2
2026-03-30 07:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-30 07:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3804140f-7c41-508c-84fa-c1a93a29189c with scrape type 2
2026-03-30 07:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3804140f-7c41-508c-84fa-c1a93a29189c with scrape type 2
2026-03-30 07:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3804140f-7c41-508c-84fa-c1a93a29189c, identifier: VG22194
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for XF01324: 2
2026-03-30 07:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-30 07:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b997853-189c-5469-b402-b6b40f9097bf with scrape type 2
2026-03-30 07:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b997853-189c-5469-b402-b6b40f9097bf with scrape type 2
2026-03-30 07:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b997853-189c-5469-b402-b6b40f9097bf, identifier: XF01324
2026-03-30 07:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-30 07:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-30 07:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194 to the API
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 520,
 'expiration_date': '2026-03-30T15:12:39Z',
 'fuel_type': 'petrol',
 'id': '3804140f-7c41-508c-84fa-c1a93a29189c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG22194',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 110138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Porsche Cayenne Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Saving data for VG22194: {'auction_closing_time': 1774883559.0, 'created_time': 1773343838.406001, 'last_price_update_time': 1774856117.430786}
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG22194') HTTP/1.1" 204 0
2026-03-30 07:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-30 07:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-30 07:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324 to the API
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:04Z',
 'fuel_type': 'petrol',
 'id': '2b997853-189c-5469-b402-b6b40f9097bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF01324',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 130542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-30',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Saving data for XF01324: {'auction_closing_time': 1774882864.0, 'created_time': 1773830257.107238, 'last_price_update_time': 1774856117.738259}
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF01324') HTTP/1.1" 204 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for JT90882: 2
2026-03-30 07:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-30 07:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with scrape type 2
2026-03-30 07:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with scrape type 2
2026-03-30 07:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245, identifier: JT90882
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for ZK08136: 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-30 07:35:17 [auto1.de] INFO: Scrape type for VG22194: 0
2026-03-30 07:35:17 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 07:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-30 07:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-30 07:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882 to the API
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:34:52Z',
 'fuel_type': 'diesel',
 'id': 'ecb85be3-f9b2-5dbb-9ea5-32d1cc207245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT90882',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 70433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Doppelkabine Limited 4x4',
 'year': 2016}
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-30 07:35:18 [auto1.de] INFO: Saving data for JT90882: {'auction_closing_time': 1774884892.0, 'created_time': 1773308317.998933, 'last_price_update_time': 1774856118.252593}
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT90882') HTTP/1.1" 204 0
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-30 07:35:18 [auto1.de] INFO: Scrape type for AJ18698: 2
2026-03-30 07:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-30 07:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with scrape type 2
2026-03-30 07:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with scrape type 2
2026-03-30 07:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ddcb168-bb8e-5e82-b533-4207d3dc1331, identifier: AJ18698
2026-03-30 07:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-30 07:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-30 07:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698 to the API
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:29Z',
 'fuel_type': 'petrol',
 'id': '0ddcb168-bb8e-5e82-b533-4207d3dc1331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ18698',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 220811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Ford Kuga 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-30 07:35:18 [auto1.de] INFO: Saving data for AJ18698: {'auction_closing_time': 1774884509.0, 'created_time': 1773226388.45839, 'last_price_update_time': 1774856118.791752}
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ18698') HTTP/1.1" 204 0
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 07:35:18 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-30 07:35:18 [auto1.de] INFO: Scrape type for AG68218: 2
2026-03-30 07:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-30 07:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-30 07:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-30 07:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a89eef-88d5-59ba-b6f7-bbf703b788ae, identifier: AG68218
2026-03-30 07:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-30 07:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-30 07:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218 to the API
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:23:31Z',
 'fuel_type': 'petrol',
 'id': '34a89eef-88d5-59ba-b6f7-bbf703b788ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG68218',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 93848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition 2WD',
 'year': 2015}
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-30 07:35:19 [auto1.de] INFO: Saving data for AG68218: {'auction_closing_time': 1774884211.0, 'created_time': 1773224937.532251, 'last_price_update_time': 1774856119.206583}
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68218') HTTP/1.1" 204 0
2026-03-30 07:35:19 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-30 07:35:19 [auto1.de] INFO: Scrape type for YZ27957: 2
2026-03-30 07:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-30 07:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with scrape type 2
2026-03-30 07:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with scrape type 2
2026-03-30 07:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e1ab8c8-047f-55d5-b305-ca12c30015d3, identifier: YZ27957
2026-03-30 07:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-30 07:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-30 07:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957 to the API
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'diesel',
 'id': '8e1ab8c8-047f-55d5-b305-ca12c30015d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ27957',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 192969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-06',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-30 07:35:19 [auto1.de] INFO: Saving data for YZ27957: {'auction_closing_time': 1774885329.0, 'created_time': 1773830668.039382, 'last_price_update_time': 1774856119.713729}
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ27957') HTTP/1.1" 204 0
2026-03-30 07:35:19 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-30 07:35:19 [auto1.de] INFO: Scrape type for GA63896: 2
2026-03-30 07:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-30 07:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with scrape type 2
2026-03-30 07:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with scrape type 2
2026-03-30 07:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677, identifier: GA63896
2026-03-30 07:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-30 07:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-30 07:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896 to the API
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:22:07Z',
 'fuel_type': 'petrol',
 'id': '8cfbdd2b-77fb-5652-8e5d-2ff509c86677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA63896',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 102114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-08',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Saving data for GA63896: {'auction_closing_time': 1774884127.0, 'created_time': 1773226226.342969, 'last_price_update_time': 1774856120.145226}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA63896') HTTP/1.1" 204 0
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Scrape type for YP19468: 2
2026-03-30 07:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-30 07:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3659ad43-83e7-5d70-abce-9537202d1677 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3659ad43-83e7-5d70-abce-9537202d1677 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3659ad43-83e7-5d70-abce-9537202d1677, identifier: YP19468
2026-03-30 07:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-30 07:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-30 07:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468 to the API
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:49:47Z',
 'fuel_type': 'petrol',
 'id': '3659ad43-83e7-5d70-abce-9537202d1677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP19468',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 209810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-06',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2007}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Saving data for YP19468: {'auction_closing_time': 1774885787.0, 'created_time': 1773307932.289852, 'last_price_update_time': 1774856120.558891}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP19468') HTTP/1.1" 204 0
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Scrape type for NZ51315: 2
2026-03-30 07:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-30 07:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbb3f1e4-ffbd-56d2-a361-c83be56685a4, identifier: NZ51315
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-30 07:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-30 07:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315 to the API
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:31Z',
 'fuel_type': 'diesel',
 'id': 'bbb3f1e4-ffbd-56d2-a361-c83be56685a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ51315',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 273555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-15',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2011}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-30 07:35:21 [auto1.de] INFO: Saving data for NZ51315: {'auction_closing_time': 1774884631.0, 'created_time': 1773302291.945328, 'last_price_update_time': 1774856121.104439}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ51315') HTTP/1.1" 204 0
2026-03-30 07:35:21 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 07:35:21 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-30 07:35:21 [auto1.de] INFO: Scrape type for VH44928: 2
2026-03-30 07:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-30 07:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-30 07:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-30 07:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711a995d-0893-5aa5-82cd-de12efe91e1d, identifier: VH44928
2026-03-30 07:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-30 07:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-30 07:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928 to the API
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'petrol',
 'id': '711a995d-0893-5aa5-82cd-de12efe91e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH44928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 91606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-30 07:35:21 [auto1.de] INFO: Saving data for VH44928: {'auction_closing_time': 1774883842.0, 'created_time': 1773741304.386548, 'last_price_update_time': 1774856121.663525}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH44928') HTTP/1.1" 204 0
2026-03-30 07:35:21 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 7564 | hits on page: 40
2026-03-30 07:35:21 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for WC28645: 2
2026-03-30 07:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-30 07:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae4c18c-d9c8-5531-b482-80f14354ba28 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae4c18c-d9c8-5531-b482-80f14354ba28 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ae4c18c-d9c8-5531-b482-80f14354ba28, identifier: WC28645
2026-03-30 07:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-30 07:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-30 07:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645 to the API
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '0ae4c18c-d9c8-5531-b482-80f14354ba28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC28645',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 190127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Saving data for WC28645: {'auction_closing_time': 1774886304.0, 'created_time': 1773305426.761809, 'last_price_update_time': 1774856122.406295}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC28645') HTTP/1.1" 204 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for JT90882: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for LN11604: 2
2026-03-30 07:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-30 07:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b80449-7956-50df-9983-34aaaefb94f6, identifier: LN11604
2026-03-30 07:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for LN11604: 2
2026-03-30 07:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b80449-7956-50df-9983-34aaaefb94f6, identifier: LN11604
2026-03-30 07:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-30 07:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-30 07:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604 to the API
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:10Z',
 'fuel_type': 'diesel',
 'id': 'a4b80449-7956-50df-9983-34aaaefb94f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN11604',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 113258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2021}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Saving data for LN11604: {'auction_closing_time': 1774883290.0, 'created_time': 1773307214.245842, 'last_price_update_time': 1774856123.289926}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN11604') HTTP/1.1" 204 0
2026-03-30 07:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-30 07:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-30 07:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604 to the API
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:10Z',
 'fuel_type': 'diesel',
 'id': 'a4b80449-7956-50df-9983-34aaaefb94f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN11604',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 113258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2021}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Saving data for LN11604: {'auction_closing_time': 1774883290.0, 'created_time': 1773307214.245842, 'last_price_update_time': 1774856123.755812}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN11604') HTTP/1.1" 204 0
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Scrape type for XR19518: 2
2026-03-30 07:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-30 07:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b312986e-b568-512f-aa36-365a041548b7, identifier: XR19518
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Scrape type for XR19518: 2
2026-03-30 07:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b312986e-b568-512f-aa36-365a041548b7, identifier: XR19518
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-30 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-30 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518 to the API
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:19:10Z',
 'fuel_type': 'petrol',
 'id': 'b312986e-b568-512f-aa36-365a041548b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR19518',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 77525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'MINI One First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2015}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Saving data for XR19518: {'auction_closing_time': 1774883950.0, 'created_time': 1773229377.561692, 'last_price_update_time': 1774856124.299558}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR19518') HTTP/1.1" 204 0
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-30 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-30 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518 to the API
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:19:10Z',
 'fuel_type': 'petrol',
 'id': 'b312986e-b568-512f-aa36-365a041548b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR19518',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 77525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'MINI One First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2015}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Saving data for XR19518: {'auction_closing_time': 1774883950.0, 'created_time': 1773229377.561692, 'last_price_update_time': 1774856124.611842}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR19518') HTTP/1.1" 204 0
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Scrape type for FE98948: 2
2026-03-30 07:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-30 07:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d, identifier: FE98948
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Scrape type for FE98948: 2
2026-03-30 07:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d, identifier: FE98948
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-30 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-30 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948 to the API
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'diesel',
 'id': 'e5afd6e9-98f6-5f43-b8e4-9d1467d6802d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE98948',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 121909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2018}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Saving data for FE98948: {'auction_closing_time': 1774882944.0, 'created_time': 1773830434.247647, 'last_price_update_time': 1774856125.165344}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE98948') HTTP/1.1" 204 0
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-30 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-30 07:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948 to the API
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'diesel',
 'id': 'e5afd6e9-98f6-5f43-b8e4-9d1467d6802d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE98948',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 121909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2018}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Saving data for FE98948: {'auction_closing_time': 1774882944.0, 'created_time': 1773830434.247647, 'last_price_update_time': 1774856125.563467}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE98948') HTTP/1.1" 204 0
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Scrape type for GS84935: 2
2026-03-30 07:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-30 07:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 859b9249-7552-5854-8a32-db9638949e5f, identifier: GS84935
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-30 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-30 07:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935 to the API
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'diesel',
 'id': '859b9249-7552-5854-8a32-db9638949e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS84935',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 135691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2017}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Saving data for GS84935: {'auction_closing_time': 1774884209.0, 'created_time': 1773304057.930398, 'last_price_update_time': 1774856126.018921}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS84935') HTTP/1.1" 204 0
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Scrape type for UK22592: 2
2026-03-30 07:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-30 07:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49009fc8-95b9-5c1b-9142-4f5469415d52 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49009fc8-95b9-5c1b-9142-4f5469415d52 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49009fc8-95b9-5c1b-9142-4f5469415d52, identifier: UK22592
2026-03-30 07:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-30 07:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-30 07:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592 to the API
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:59:20Z',
 'fuel_type': 'petrol',
 'id': '49009fc8-95b9-5c1b-9142-4f5469415d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK22592',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 91948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Saving data for UK22592: {'auction_closing_time': 1774886360.0, 'created_time': 1773308312.802282, 'last_price_update_time': 1774856126.428295}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK22592') HTTP/1.1" 204 0
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Scrape type for FU28651: 2
2026-03-30 07:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-30 07:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac, identifier: FU28651
2026-03-30 07:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-30 07:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-30 07:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651 to the API
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:15:08Z',
 'fuel_type': 'diesel',
 'id': '64ac5bc4-3b2b-5a12-8754-d5e2069e1aac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU28651',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Exclusive',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Exclusive',
 'year': 2015}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Saving data for FU28651: {'auction_closing_time': 1774883708.0, 'created_time': 1773341221.040528, 'last_price_update_time': 1774856126.918119}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU28651') HTTP/1.1" 204 0
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Scrape type for GY36946: 2
2026-03-30 07:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-30 07:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac59fd23-fbde-544e-9e26-f2427b284211 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac59fd23-fbde-544e-9e26-f2427b284211 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac59fd23-fbde-544e-9e26-f2427b284211, identifier: GY36946
2026-03-30 07:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-30 07:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-30 07:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946 to the API
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:36Z',
 'fuel_type': 'petrol',
 'id': 'ac59fd23-fbde-544e-9e26-f2427b284211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY36946',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 72940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Saving data for GY36946: {'auction_closing_time': 1774882836.0, 'created_time': 1773304404.97222, 'last_price_update_time': 1774856127.347771}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY36946') HTTP/1.1" 204 0
2026-03-30 07:35:27 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Scrape type for PV67596: 2
2026-03-30 07:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-30 07:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4, identifier: PV67596
2026-03-30 07:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-30 07:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-30 07:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596 to the API
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'petrol',
 'id': 'a97bb929-ab7e-58d6-8ccc-be5d1c033dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV67596',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 204429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-15',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Saving data for PV67596: {'auction_closing_time': 1774884670.0, 'created_time': 1773741417.150559, 'last_price_update_time': 1774856127.79544}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV67596') HTTP/1.1" 204 0
2026-03-30 07:35:27 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Scrape type for ET29931: 2
2026-03-30 07:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-30 07:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b54358-cb34-5f19-b37a-e4b31eed7074 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b54358-cb34-5f19-b37a-e4b31eed7074 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1b54358-cb34-5f19-b37a-e4b31eed7074, identifier: ET29931
2026-03-30 07:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-30 07:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-30 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931 to the API
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:44Z',
 'fuel_type': 'diesel',
 'id': 'c1b54358-cb34-5f19-b37a-e4b31eed7074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET29931',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 394395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Saving data for ET29931: {'auction_closing_time': 1774883864.0, 'created_time': 1773226385.191327, 'last_price_update_time': 1774856128.239247}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET29931') HTTP/1.1" 204 0
2026-03-30 07:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for BP04527: 2
2026-03-30 07:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-30 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6f4adbf-c9cf-5e73-948a-c14f894df8a2, identifier: BP04527
2026-03-30 07:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-30 07:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-30 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527 to the API
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'diesel',
 'id': 'e6f4adbf-c9cf-5e73-948a-c14f894df8a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP04527',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 130083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Saving data for BP04527: {'auction_closing_time': 1774883427.0, 'created_time': 1773304817.706272, 'last_price_update_time': 1774856128.636498}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP04527') HTTP/1.1" 204 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for PW13353: 2
2026-03-30 07:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-30 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3acbe9e-0c4e-5f30-96b9-5de7425155be with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3acbe9e-0c4e-5f30-96b9-5de7425155be with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3acbe9e-0c4e-5f30-96b9-5de7425155be, identifier: PW13353
2026-03-30 07:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-30 07:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-30 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353 to the API
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:38Z',
 'fuel_type': 'petrol',
 'id': 'a3acbe9e-0c4e-5f30-96b9-5de7425155be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW13353',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 90489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Saving data for PW13353: {'auction_closing_time': 1774885778.0, 'created_time': 1773830845.810083, 'last_price_update_time': 1774856129.146755}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW13353') HTTP/1.1" 204 0
2026-03-30 07:35:29 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 7570 | hits on page: 40
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for PW13353: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for JG07802: 2
2026-03-30 07:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-30 07:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4820be2-5991-5042-a105-0deabfe89a8d with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4820be2-5991-5042-a105-0deabfe89a8d with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4820be2-5991-5042-a105-0deabfe89a8d, identifier: JG07802
2026-03-30 07:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-30 07:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-30 07:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802 to the API
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:13Z',
 'fuel_type': 'petrol',
 'id': 'c4820be2-5991-5042-a105-0deabfe89a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG07802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 105862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-11',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2015}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Saving data for JG07802: {'auction_closing_time': 1774885093.0, 'created_time': 1773306695.449717, 'last_price_update_time': 1774856129.643542}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG07802') HTTP/1.1" 204 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for RC29433: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for YE68062: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for FV18032: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for AY52280: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for MT94431: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for PS96844: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for DH90644: 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 07:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:31 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 7572 | hits on page: 40
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for JX17903: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for NX25429: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for FB30616: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for EM09444: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for KJ73179: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for VM07579: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for UZ89172: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for EF06925: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for UE56505: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for TR93945: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for UF10359: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for ND89828: 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-30 07:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:32 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 7575 | hits on page: 40
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for MF60875: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for RF07068: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for KD86114: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for EF75873: 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for HZ55109: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for LA18154: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for CW95568: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for GD26044: 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-30 07:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:34 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 7576 | hits on page: 40
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for NH06338: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for MF86039: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for SJ64604: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for DT57257: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for VT63649: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for JX79740: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for FR69109: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for BS19118: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for SL92984: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for GH39731: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for SN42334: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for NV30450: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for ZW50012: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for AB49133: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for KB67170: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for KF93262: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for BP80209: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for FR18143: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for WF13702: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-30 07:35:35 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 07:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:36 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 7579 | hits on page: 40
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for DC32299: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for ZM10504: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for CH24864: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for NA60022: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for AK26500: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for JL32962: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for UN88738: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for TV18525: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for MU81714: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for ZL07582: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for PW12377: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for RD52099: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for CX30934: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 07:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:37 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 7582 | hits on page: 40
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for SS07399: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for RR54011: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for KP96972: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for DS69815: 2
2026-03-30 07:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-30 07:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-30 07:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-30 07:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 768d5fd6-295d-5f44-9d3a-f2841abe95e3, identifier: DS69815
2026-03-30 07:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-30 07:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-30 07:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815 to the API
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 525,
 'expiration_date': '2026-03-30T15:07:08Z',
 'fuel_type': 'petrol',
 'id': '768d5fd6-295d-5f44-9d3a-f2841abe95e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS69815',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 94482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-11',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 Kompressor Autobiography '
          'Dynamic',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2019}
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Saving data for DS69815: {'auction_closing_time': 1774883228.0, 'created_time': 1774550472.546837, 'last_price_update_time': 1774856138.569469}
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS69815') HTTP/1.1" 204 0
2026-03-30 07:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for NU91903: 2
2026-03-30 07:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-30 07:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-30 07:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-30 07:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9264353-4757-570c-80f7-56324704a887, identifier: NU91903
2026-03-30 07:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-30 07:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-30 07:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903 to the API
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:57Z',
 'fuel_type': 'diesel',
 'id': 'a9264353-4757-570c-80f7-56324704a887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU91903',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 294162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-06-30',
 'seller_name': None,
 'title': 'Ford Ranger 2.5 TD Extrakabine 4x4',
 'transmission': 'manual',
 'trim': 'Extrakabine 4x4',
 'year': 1996}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-30 07:35:39 [auto1.de] INFO: Saving data for NU91903: {'auction_closing_time': 1774883997.0, 'created_time': 1774552774.43453, 'last_price_update_time': 1774856139.235674}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU91903') HTTP/1.1" 204 0
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 07:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:40 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 7585 | hits on page: 40
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for YD12579: 2
2026-03-30 07:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-30 07:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-30 07:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-30 07:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26, identifier: YD12579
2026-03-30 07:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-30 07:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-30 07:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579 to the API
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:53Z',
 'fuel_type': 'petrol',
 'id': '2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD12579',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 64302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-18',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Comfort AWD',
 'transmission': 'automatic',
 'trim': 'Comfort AWD',
 'year': 2011}
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Saving data for YD12579: {'auction_closing_time': 1774885313.0, 'created_time': 1774551513.529619, 'last_price_update_time': 1774856140.845969}
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD12579') HTTP/1.1" 204 0
2026-03-30 07:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for UP80660: 2
2026-03-30 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-30 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfd998f-1017-5859-88b0-899bfbf83397, identifier: UP80660
2026-03-30 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-30 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-30 07:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660 to the API
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:41:06Z',
 'fuel_type': 'diesel',
 'id': '8cfd998f-1017-5859-88b0-899bfbf83397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP80660',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 121243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2019}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Saving data for UP80660: {'auction_closing_time': 1774885266.0, 'created_time': 1774550538.583381, 'last_price_update_time': 1774856141.64547}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP80660') HTTP/1.1" 204 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for JE51939: 2
2026-03-30 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-30 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648b4ca1-e5c9-55db-893e-80ab38c67e99, identifier: JE51939
2026-03-30 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-30 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-30 07:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939 to the API
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'hybrid',
 'id': '648b4ca1-e5c9-55db-893e-80ab38c67e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE51939',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 30566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-23',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Saving data for JE51939: {'auction_closing_time': 1774884289.0, 'created_time': 1774550888.486793, 'last_price_update_time': 1774856142.266971}
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE51939') HTTP/1.1" 204 0
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-30 07:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:43 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 7589 | hits on page: 40
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for KC39120: 2
2026-03-30 07:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-30 07:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-30 07:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-30 07:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a, identifier: KC39120
2026-03-30 07:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-30 07:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-30 07:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120 to the API
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:28:02Z',
 'fuel_type': 'petrol',
 'id': '0f1e3fdb-040b-5ad2-8326-bad3e4662b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC39120',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 84743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Saving data for KC39120: {'auction_closing_time': 1774884482.0, 'created_time': 1774551862.836859, 'last_price_update_time': 1774856144.355872}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC39120') HTTP/1.1" 204 0
2026-03-30 07:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Scrape type for LM88961: 2
2026-03-30 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-30 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67eb503-4833-5bdc-bfbe-9159a5046b2d, identifier: LM88961
2026-03-30 07:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-30 07:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-30 07:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961 to the API
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:55:01Z',
 'fuel_type': 'petrol',
 'id': 'd67eb503-4833-5bdc-bfbe-9159a5046b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM88961',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Saving data for LM88961: {'auction_closing_time': 1774886101.0, 'created_time': 1774552892.837492, 'last_price_update_time': 1774856144.866555}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM88961') HTTP/1.1" 204 0
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Scrape type for AN54197: 2
2026-03-30 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-30 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31358549-8be4-5779-90bf-bb86c234c591, identifier: AN54197
2026-03-30 07:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-30 07:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-30 07:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197 to the API
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'petrol',
 'id': '31358549-8be4-5779-90bf-bb86c234c591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN54197',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 4',
 'odometer': 120286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'Audi RS 4 2.9 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Saving data for AN54197: {'auction_closing_time': 1774885579.0, 'created_time': 1773223317.122125, 'last_price_update_time': 1774856145.356844}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN54197') HTTP/1.1" 204 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for HW22525: 2
2026-03-30 07:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-30 07:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-30 07:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-30 07:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4, identifier: HW22525
2026-03-30 07:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-30 07:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-30 07:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525 to the API
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'diesel',
 'id': '5a0f6238-c86e-58c2-b7a9-4cd9787872e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW22525',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 257059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Saving data for HW22525: {'auction_closing_time': 1774884938.0, 'created_time': 1774550699.773191, 'last_price_update_time': 1774856145.857669}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW22525') HTTP/1.1" 204 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Scrape type for UY73943: 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for UN58886: 2
2026-03-30 07:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-30 07:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0836e142-c706-50e8-97c6-715cd094342e, identifier: UN58886
2026-03-30 07:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-30 07:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-30 07:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886 to the API
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:48:04Z',
 'fuel_type': 'petrol',
 'id': '0836e142-c706-50e8-97c6-715cd094342e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN58886',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 113829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-23',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Saving data for UN58886: {'auction_closing_time': 1774885684.0, 'created_time': 1774589450.978319, 'last_price_update_time': 1774856146.75583}
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN58886') HTTP/1.1" 204 0
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 07:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:47 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 7594 | hits on page: 40
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for JN76212: 2
2026-03-30 07:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-30 07:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-30 07:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-30 07:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9984f-742a-51a3-a9f2-7a2c07858cd7, identifier: JN76212
2026-03-30 07:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-30 07:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-30 07:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212 to the API
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': '10f9984f-742a-51a3-a9f2-7a2c07858cd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN76212',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 88108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Saving data for JN76212: {'auction_closing_time': 1774885097.0, 'created_time': 1774552713.299455, 'last_price_update_time': 1774856148.444547}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN76212') HTTP/1.1" 204 0
2026-03-30 07:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Scrape type for TF08287: 2
2026-03-30 07:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-30 07:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-30 07:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-30 07:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f2d600-0ecc-591c-8871-98bb0a62dfaf, identifier: TF08287
2026-03-30 07:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-30 07:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-30 07:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287 to the API
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:00:10Z',
 'fuel_type': 'petrol',
 'id': '48f2d600-0ecc-591c-8871-98bb0a62dfaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF08287',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A2',
 'odometer': 247755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-14',
 'seller_name': None,
 'title': 'Audi A2 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Saving data for TF08287: {'auction_closing_time': 1774882810.0, 'created_time': 1774550473.956987, 'last_price_update_time': 1774856148.907878}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF08287') HTTP/1.1" 204 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-30 07:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:50 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 7595 | hits on page: 40
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for JV22464: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for XM82116: 2
2026-03-30 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-30 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2bf380-4b4f-5d58-98f9-2209433faafb, identifier: XM82116
2026-03-30 07:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-30 07:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-30 07:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116 to the API
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:07:02Z',
 'fuel_type': 'diesel',
 'id': 'ca2bf380-4b4f-5d58-98f9-2209433faafb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM82116',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 227755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-05',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Saving data for XM82116: {'auction_closing_time': 1774883222.0, 'created_time': 1774551775.279452, 'last_price_update_time': 1774856150.688481}
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM82116') HTTP/1.1" 204 0
2026-03-30 07:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for GY48177: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for SV18867: 2
2026-03-30 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-30 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56507ea7-c416-5162-aa4e-18dd3b19e8a1, identifier: SV18867
2026-03-30 07:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-30 07:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-30 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867 to the API
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:13:44Z',
 'fuel_type': 'diesel',
 'id': '56507ea7-c416-5162-aa4e-18dd3b19e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV18867',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 174136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Crossborder',
 'transmission': 'manual',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Saving data for SV18867: {'auction_closing_time': 1774883624.0, 'created_time': 1774552831.786501, 'last_price_update_time': 1774856151.249324}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV18867') HTTP/1.1" 204 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for MF41784: 2
2026-03-30 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-30 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50, identifier: MF41784
2026-03-30 07:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-30 07:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-30 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784 to the API
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:07:16Z',
 'fuel_type': 'diesel',
 'id': '30a7f072-c5cb-5b4b-bb68-02bd8e8aca50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41784',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 250128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-02',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2009}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Saving data for MF41784: {'auction_closing_time': 1774883236.0, 'created_time': 1773946414.816105, 'last_price_update_time': 1774856151.788762}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41784') HTTP/1.1" 204 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Scrape type for FK00341: 2
2026-03-30 07:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-30 07:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-30 07:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-30 07:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd37cb63-2730-5a97-ad3c-c132ebb66158, identifier: FK00341
2026-03-30 07:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-30 07:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-30 07:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341 to the API
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:46Z',
 'fuel_type': 'petrol',
 'id': 'bd37cb63-2730-5a97-ad3c-c132ebb66158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK00341',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 91338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2017}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Saving data for FK00341: {'auction_closing_time': 1774885426.0, 'created_time': 1774552056.092032, 'last_price_update_time': 1774856152.433306}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK00341') HTTP/1.1" 204 0
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 07:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:53 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 7598 | hits on page: 40
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for LE46493: 2
2026-03-30 07:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-30 07:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c, identifier: LE46493
2026-03-30 07:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-30 07:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-30 07:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493 to the API
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:44:54Z',
 'fuel_type': 'petrol',
 'id': '06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE46493',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 139206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-02',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Intro Edition 2WD',
 'transmission': 'manual',
 'trim': 'Intro Edition 2WD',
 'year': 2011}
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Saving data for LE46493: {'auction_closing_time': 1774885494.0, 'created_time': 1774550436.507507, 'last_price_update_time': 1774856153.738074}
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE46493') HTTP/1.1" 204 0
2026-03-30 07:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for HJ62454: 2
2026-03-30 07:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-30 07:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea, identifier: HJ62454
2026-03-30 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-30 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-30 07:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454 to the API
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:52:58Z',
 'fuel_type': 'petrol',
 'id': '0fb819b1-bcbb-53c1-9118-e2454fcc35ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ62454',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 101089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2017}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Saving data for HJ62454: {'auction_closing_time': 1774885978.0, 'created_time': 1774552633.56325, 'last_price_update_time': 1774856154.398758}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ62454') HTTP/1.1" 204 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-30 07:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:56 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 7600 | hits on page: 40
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for ZM17001: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 07:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:59 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 7603 | hits on page: 40
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for RM28655: 2
2026-03-30 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-30 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54a8567-4edc-5867-bbbe-2b9e136ad539, identifier: RM28655
2026-03-30 07:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-30 07:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-30 07:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655 to the API
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': 'c54a8567-4edc-5867-bbbe-2b9e136ad539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM28655',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 62430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Saving data for RM28655: {'auction_closing_time': 1774883431.0, 'created_time': 1774552530.58863, 'last_price_update_time': 1774856160.65125}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM28655') HTTP/1.1" 204 0
2026-03-30 07:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for LB57303: 2
2026-03-30 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-30 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-30 07:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 946a967a-ea54-56ac-b5ff-18105f40c9e4, identifier: LB57303
2026-03-30 07:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-30 07:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-30 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303 to the API
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'diesel',
 'id': '946a967a-ea54-56ac-b5ff-18105f40c9e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB57303',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 289870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Trendline 4Motion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion',
 'year': 2008}
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Saving data for LB57303: {'auction_closing_time': 1774883700.0, 'created_time': 1774552932.056943, 'last_price_update_time': 1774856161.336373}
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB57303') HTTP/1.1" 204 0
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Scrape type for TB88794: 2
2026-03-30 07:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-30 07:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-30 07:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-30 07:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44db64be-23d1-518b-b6ae-dfbd5dd836ef, identifier: TB88794
2026-03-30 07:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-30 07:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-30 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794 to the API
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'petrol',
 'id': '44db64be-23d1-518b-b6ae-dfbd5dd836ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB88794',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 116384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Saving data for TB88794: {'auction_closing_time': 1774885715.0, 'created_time': 1774552630.815968, 'last_price_update_time': 1774856161.962729}
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB88794') HTTP/1.1" 204 0
2026-03-30 07:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:02 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 7606 | hits on page: 40
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Scrape type for BB54670: 2
2026-03-30 07:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-30 07:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-30 07:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd, identifier: BB54670
2026-03-30 07:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-30 07:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-30 07:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670 to the API
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:33:38Z',
 'fuel_type': 'diesel',
 'id': '78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB54670',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 139161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Saving data for BB54670: {'auction_closing_time': 1774884818.0, 'created_time': 1773344646.450689, 'last_price_update_time': 1774856163.475143}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB54670') HTTP/1.1" 204 0
2026-03-30 07:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for VG84958: 2
2026-03-30 07:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-30 07:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64b310b-2d27-529f-bc32-585c17bfedf0, identifier: VG84958
2026-03-30 07:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-30 07:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-30 07:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958 to the API
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:41:09Z',
 'fuel_type': 'petrol',
 'id': 'e64b310b-2d27-529f-bc32-585c17bfedf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG84958',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 140213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-17',
 'seller_name': None,
 'title': 'Porsche Boxster S',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Saving data for VG84958: {'auction_closing_time': 1774885269.0, 'created_time': 1774552137.726342, 'last_price_update_time': 1774856164.140727}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG84958') HTTP/1.1" 204 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for EH25554: 2
2026-03-30 07:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-30 07:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a, identifier: EH25554
2026-03-30 07:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-30 07:36:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-30 07:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554 to the API
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'purple',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:39Z',
 'fuel_type': 'diesel',
 'id': '1e2eed26-73a1-5058-8d45-a0b4e6f62e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH25554',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 295931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.5 Turbodiesel I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2011}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Saving data for EH25554: {'auction_closing_time': 1774886259.0, 'created_time': 1774550524.354712, 'last_price_update_time': 1774856164.899324}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH25554') HTTP/1.1" 204 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for HJ54596: 2
2026-03-30 07:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-30 07:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-30 07:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78dcb082-d16c-5556-aa94-a7fb0d3475ce, identifier: HJ54596
2026-03-30 07:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 07:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-30 07:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596 to the API
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:57:23Z',
 'fuel_type': 'gas',
 'id': '78dcb082-d16c-5556-aa94-a7fb0d3475ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54596',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 69378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2022}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Saving data for HJ54596: {'auction_closing_time': 1774886243.0, 'created_time': 1774552428.278473, 'last_price_update_time': 1774856165.543561}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54596') HTTP/1.1" 204 0
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 07:36:06 [scrapy.extensions.logstats] INFO: Crawled 244 pages (at 16 pages/min), scraped 366 items (at 73 items/min)
2026-03-30 07:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:10 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 7616 | hits on page: 40
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for UV26569: 2
2026-03-30 07:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-30 07:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-30 07:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-30 07:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52870aa1-64fe-55f8-bcb2-c41fec631421, identifier: UV26569
2026-03-30 07:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-30 07:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-30 07:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569 to the API
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:07:12Z',
 'fuel_type': 'petrol',
 'id': '52870aa1-64fe-55f8-bcb2-c41fec631421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV26569',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 91359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-24',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-30 07:36:11 [auto1.de] INFO: Saving data for UV26569: {'auction_closing_time': 1774883232.0, 'created_time': 1774552993.575805, 'last_price_update_time': 1774856171.222228}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV26569') HTTP/1.1" 204 0
2026-03-30 07:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 07:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:12 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 7617 | hits on page: 40
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for KV36004: 0
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for TH75068: 2
2026-03-30 07:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-30 07:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-30 07:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-30 07:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ba38eb-0bd3-55c4-8f67-b4be6553898f, identifier: TH75068
2026-03-30 07:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-30 07:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-30 07:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068 to the API
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:50:30Z',
 'fuel_type': 'diesel',
 'id': '60ba38eb-0bd3-55c4-8f67-b4be6553898f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH75068',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 213073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Saving data for TH75068: {'auction_closing_time': 1774885830.0, 'created_time': 1774552169.193334, 'last_price_update_time': 1774856172.821355}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH75068') HTTP/1.1" 204 0
2026-03-30 07:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for JD70113: 2
2026-03-30 07:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-30 07:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-30 07:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-30 07:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66a6e5e4-adf3-5cde-a18a-066d21844c1e, identifier: JD70113
2026-03-30 07:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-30 07:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-30 07:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113 to the API
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'petrol',
 'id': '66a6e5e4-adf3-5cde-a18a-066d21844c1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD70113',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 148411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Saving data for JD70113: {'auction_closing_time': 1774886220.0, 'created_time': 1774550433.961251, 'last_price_update_time': 1774856173.795811}
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD70113') HTTP/1.1" 204 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for TD06456: 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for DG73044: 2
2026-03-30 07:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-30 07:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f966bfbd-bd95-5299-848b-f2633a8cb12a, identifier: DG73044
2026-03-30 07:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-30 07:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-30 07:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044 to the API
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:05:43Z',
 'fuel_type': 'petrol',
 'id': 'f966bfbd-bd95-5299-848b-f2633a8cb12a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG73044',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 48162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Saving data for DG73044: {'auction_closing_time': 1774883143.0, 'created_time': 1774552677.139737, 'last_price_update_time': 1774856174.453937}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG73044') HTTP/1.1" 204 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-30 07:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:15 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 7619 | hits on page: 40
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: US43373
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for CP99772: 2
2026-03-30 07:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-30 07:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-30 07:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-30 07:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c, identifier: CP99772
2026-03-30 07:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-30 07:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-30 07:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772 to the API
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:34:32Z',
 'fuel_type': 'petrol',
 'id': '6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP99772',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 88770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Saving data for CP99772: {'auction_closing_time': 1774884872.0, 'created_time': 1774552784.53474, 'last_price_update_time': 1774856176.181119}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP99772') HTTP/1.1" 204 0
2026-03-30 07:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for SY16661: 2
2026-03-30 07:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-30 07:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-30 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-30 07:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa1ebb92-e712-5112-9e0a-45d63c1d0a53, identifier: SY16661
2026-03-30 07:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-30 07:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-30 07:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661 to the API
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:32:24Z',
 'fuel_type': 'petrol',
 'id': 'fa1ebb92-e712-5112-9e0a-45d63c1d0a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY16661',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 154075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Opel Insignia 1.6 SIDI Turbo Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Saving data for SY16661: {'auction_closing_time': 1774884744.0, 'created_time': 1774552932.970288, 'last_price_update_time': 1774856176.739564}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY16661') HTTP/1.1" 204 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 07:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:17 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 7624 | hits on page: 40
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for ZW06761: 2
2026-03-30 07:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-30 07:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7889c2a0-81fd-5255-818c-e6b29011217a, identifier: ZW06761
2026-03-30 07:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-30 07:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-30 07:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761 to the API
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'diesel',
 'id': '7889c2a0-81fd-5255-818c-e6b29011217a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW06761',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 242856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-03',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 120 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 120 Multijet',
 'year': 2010}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Saving data for ZW06761: {'auction_closing_time': 1774884813.0, 'created_time': 1774552694.371132, 'last_price_update_time': 1774856178.534333}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW06761') HTTP/1.1" 204 0
2026-03-30 07:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 07:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:19 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 7628 | hits on page: 40
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for PC60624: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-30 07:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:22 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 7631 | hits on page: 40
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for WS48624: 2
2026-03-30 07:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-30 07:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-30 07:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-30 07:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f182aa22-66f8-548c-8487-91e34763c870, identifier: WS48624
2026-03-30 07:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-30 07:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-30 07:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624 to the API
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:42Z',
 'fuel_type': 'diesel',
 'id': 'f182aa22-66f8-548c-8487-91e34763c870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS48624',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 337077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-30',
 'seller_name': None,
 'title': 'Fiat Scudo 1.6 JTDM 10 SX L1H1 90 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 90 Multijet',
 'year': 2010}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Saving data for WS48624: {'auction_closing_time': 1774884882.0, 'created_time': 1774553009.584312, 'last_price_update_time': 1774856182.824889}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS48624') HTTP/1.1" 204 0
2026-03-30 07:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for EU98596: 2
2026-03-30 07:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-30 07:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-30 07:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-30 07:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148, identifier: EU98596
2026-03-30 07:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-30 07:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-30 07:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596 to the API
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:53:57Z',
 'fuel_type': 'diesel',
 'id': '8e70c1c9-40a0-5ab5-9cc7-470279c3c148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98596',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 181848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'automatic',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Saving data for EU98596: {'auction_closing_time': 1774886037.0, 'created_time': 1773946413.761746, 'last_price_update_time': 1774856183.849872}
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU98596') HTTP/1.1" 204 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-30 07:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:25 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 7631 | hits on page: 40
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Scrape type for VH61709: 2
2026-03-30 07:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-30 07:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e457e378-4d4d-59aa-8764-8a46dffa1adf, identifier: VH61709
2026-03-30 07:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-30 07:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-30 07:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709 to the API
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:39:51Z',
 'fuel_type': 'petrol',
 'id': 'e457e378-4d4d-59aa-8764-8a46dffa1adf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61709',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 242960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2010}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Saving data for VH61709: {'auction_closing_time': 1774885191.0, 'created_time': 1773917096.745121, 'last_price_update_time': 1774856185.527175}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH61709') HTTP/1.1" 204 0
2026-03-30 07:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Scrape type for JM39243: 2
2026-03-30 07:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-30 07:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d008177-ccec-5e27-a287-4eb3f2095452, identifier: JM39243
2026-03-30 07:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-30 07:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-30 07:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243 to the API
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:27:12Z',
 'fuel_type': 'diesel',
 'id': '6d008177-ccec-5e27-a287-4eb3f2095452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM39243',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 279140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Saving data for JM39243: {'auction_closing_time': 1774884432.0, 'created_time': 1774589461.054211, 'last_price_update_time': 1774856186.105812}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM39243') HTTP/1.1" 204 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for RG01801: 2
2026-03-30 07:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-30 07:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fecde1-f447-581f-a0b5-aefa61776a37, identifier: RG01801
2026-03-30 07:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-30 07:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-30 07:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801 to the API
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:52:26Z',
 'fuel_type': 'diesel',
 'id': '47fecde1-f447-581f-a0b5-aefa61776a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG01801',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 219874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline BlueMotion Tech.',
 'year': 2013}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Saving data for RG01801: {'auction_closing_time': 1774885946.0, 'created_time': 1774550431.685973, 'last_price_update_time': 1774856186.607582}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG01801') HTTP/1.1" 204 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for YA93761: 2
2026-03-30 07:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-30 07:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 258aa3c4-6137-5877-9069-b9a14fa8ce63, identifier: YA93761
2026-03-30 07:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-30 07:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-30 07:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761 to the API
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:22:04Z',
 'fuel_type': 'petrol',
 'id': '258aa3c4-6137-5877-9069-b9a14fa8ce63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA93761',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 238783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Saving data for YA93761: {'auction_closing_time': 1774884124.0, 'created_time': 1774550490.082061, 'last_price_update_time': 1774856187.189846}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA93761') HTTP/1.1" 204 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for ZJ78917: 2
2026-03-30 07:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-30 07:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c307ab0-839c-50fc-b200-ace68ac89656, identifier: ZJ78917
2026-03-30 07:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-30 07:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-30 07:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917 to the API
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:33Z',
 'fuel_type': 'diesel',
 'id': '5c307ab0-839c-50fc-b200-ace68ac89656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ78917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 188156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2005}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Saving data for ZJ78917: {'auction_closing_time': 1774885653.0, 'created_time': 1774550715.744846, 'last_price_update_time': 1774856187.715946}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ78917') HTTP/1.1" 204 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for AA51921: 2
2026-03-30 07:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-30 07:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32cf3593-42a2-54cf-aeee-6e07c47047ac, identifier: AA51921
2026-03-30 07:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-30 07:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-30 07:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921 to the API
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:12:02Z',
 'fuel_type': 'diesel',
 'id': '32cf3593-42a2-54cf-aeee-6e07c47047ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA51921',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 48182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Sport Lang',
 'transmission': 'manual',
 'trim': 'Kasten Sport Lang',
 'year': 2017}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Saving data for AA51921: {'auction_closing_time': 1774883522.0, 'created_time': 1774552732.297613, 'last_price_update_time': 1774856188.26995}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA51921') HTTP/1.1" 204 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 07:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:28 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 7637 | hits on page: 40
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for HT62005: 2
2026-03-30 07:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-30 07:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abf96e34-ab6c-55a5-a694-b3c1aa150498, identifier: HT62005
2026-03-30 07:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-30 07:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-30 07:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005 to the API
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'diesel',
 'id': 'abf96e34-ab6c-55a5-a694-b3c1aa150498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT62005',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 88085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Saving data for HT62005: {'auction_closing_time': 1774885291.0, 'created_time': 1774550647.246186, 'last_price_update_time': 1774856189.235886}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT62005') HTTP/1.1" 204 0
2026-03-30 07:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for XV87595: 2
2026-03-30 07:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-30 07:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa861509-4fca-5463-aa04-17cd6dea1c8a, identifier: XV87595
2026-03-30 07:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-30 07:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-30 07:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595 to the API
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:51Z',
 'fuel_type': 'petrol',
 'id': 'aa861509-4fca-5463-aa04-17cd6dea1c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV87595',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 51733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2016}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Saving data for XV87595: {'auction_closing_time': 1774885071.0, 'created_time': 1774552739.401406, 'last_price_update_time': 1774856189.959924}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV87595') HTTP/1.1" 204 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for KR20197: 2
2026-03-30 07:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-30 07:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38, identifier: KR20197
2026-03-30 07:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-30 07:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-30 07:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197 to the API
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:26:28Z',
 'fuel_type': 'petrol',
 'id': '8ac9c1dc-800d-5013-bff2-8965d9b1bd38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR20197',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 97069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-01',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Saving data for KR20197: {'auction_closing_time': 1774884388.0, 'created_time': 1774553060.659748, 'last_price_update_time': 1774856190.484097}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR20197') HTTP/1.1" 204 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for NT47170: 2
2026-03-30 07:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-30 07:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f80e89de-8bc7-51c8-8078-1bb6d162e8b3, identifier: NT47170
2026-03-30 07:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-30 07:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-30 07:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170 to the API
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:10:52Z',
 'fuel_type': 'diesel',
 'id': 'f80e89de-8bc7-51c8-8078-1bb6d162e8b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT47170',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 203812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2006}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Saving data for NT47170: {'auction_closing_time': 1774883452.0, 'created_time': 1774550531.079701, 'last_price_update_time': 1774856190.97199}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT47170') HTTP/1.1" 204 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-30 07:36:31 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-30 07:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:32 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 7642 | hits on page: 40
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for UC60552: 2
2026-03-30 07:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-30 07:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ece0655-13ae-5e38-93cc-8f662eab1ef2, identifier: UC60552
2026-03-30 07:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-30 07:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-30 07:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552 to the API
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:24:59Z',
 'fuel_type': 'petrol',
 'id': '5ece0655-13ae-5e38-93cc-8f662eab1ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC60552',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 173128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': "Kia cee'd 1.6 TGDI GT-Challenge",
 'transmission': 'manual',
 'trim': 'GT-Challenge',
 'year': 2017}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Saving data for UC60552: {'auction_closing_time': 1774884299.0, 'created_time': 1774552542.171765, 'last_price_update_time': 1774856192.822589}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC60552') HTTP/1.1" 204 0
2026-03-30 07:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 07:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:34 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 7646 | hits on page: 40
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: US49854
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for JS64432: 2
2026-03-30 07:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-30 07:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-30 07:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-30 07:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd7fab7d-aa15-552a-9ec9-f89955258a3c, identifier: JS64432
2026-03-30 07:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-30 07:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-30 07:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432 to the API
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:43:42Z',
 'fuel_type': 'petrol',
 'id': 'cd7fab7d-aa15-552a-9ec9-f89955258a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS64432',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 122190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Saving data for JS64432: {'auction_closing_time': 1774885422.0, 'created_time': 1774552165.266365, 'last_price_update_time': 1774856195.123353}
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS64432') HTTP/1.1" 204 0
2026-03-30 07:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for VU33733: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-30 07:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:36 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 7648 | hits on page: 40
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for TU08005: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for EE77460: 2
2026-03-30 07:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-30 07:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541fd090-9fa2-584e-ad07-6100c00deb31, identifier: EE77460
2026-03-30 07:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-30 07:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-30 07:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460 to the API
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:27Z',
 'fuel_type': 'petrol',
 'id': '541fd090-9fa2-584e-ad07-6100c00deb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE77460',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 102839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Smart forfour 1.0 youngster',
 'transmission': 'manual',
 'trim': 'youngster',
 'year': 2018}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Saving data for EE77460: {'auction_closing_time': 1774885347.0, 'created_time': 1774552151.520308, 'last_price_update_time': 1774856197.050875}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE77460') HTTP/1.1" 204 0
2026-03-30 07:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for AF88464: 2
2026-03-30 07:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-30 07:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-30 07:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-30 07:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbcac482-a0ce-5797-9f0a-655b7f4cbc26, identifier: AF88464
2026-03-30 07:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-30 07:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-30 07:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464 to the API
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:53:50Z',
 'fuel_type': 'petrol',
 'id': 'bbcac482-a0ce-5797-9f0a-655b7f4cbc26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF88464',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 155904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-04',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Saving data for AF88464: {'auction_closing_time': 1774886030.0, 'created_time': 1774550647.661147, 'last_price_update_time': 1774856197.690442}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF88464') HTTP/1.1" 204 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 07:36:37 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-30 07:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:38 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 7653 | hits on page: 40
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for AM78577: 2
2026-03-30 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-30 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5941aaef-ac49-547c-9e29-fa0d744649d0, identifier: AM78577
2026-03-30 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-30 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-30 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577 to the API
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:57Z',
 'fuel_type': 'diesel',
 'id': '5941aaef-ac49-547c-9e29-fa0d744649d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM78577',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 218664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
 'transmission': 'manual',
 'trim': 'Evalia Tekna',
 'year': 2014}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Saving data for AM78577: {'auction_closing_time': 1774884597.0, 'created_time': 1774551452.446005, 'last_price_update_time': 1774856199.283247}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM78577') HTTP/1.1" 204 0
2026-03-30 07:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for PW12132: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for FE12352: 2
2026-03-30 07:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-30 07:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9f5f5d-7d0c-549d-9eab-deb833afc929, identifier: FE12352
2026-03-30 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-30 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-30 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352 to the API
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:19:09Z',
 'fuel_type': 'petrol',
 'id': '1d9f5f5d-7d0c-549d-9eab-deb833afc929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE12352',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 14854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Saving data for FE12352: {'auction_closing_time': 1774883949.0, 'created_time': 1774553037.704881, 'last_price_update_time': 1774856199.981264}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE12352') HTTP/1.1" 204 0
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 07:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:41 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 7655 | hits on page: 40
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for KK19800: 2
2026-03-30 07:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-30 07:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-30 07:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-30 07:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc01c29-9127-57a0-b84a-ed1bd9c15828, identifier: KK19800
2026-03-30 07:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-30 07:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-30 07:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800 to the API
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:57Z',
 'fuel_type': 'diesel',
 'id': 'edc01c29-9127-57a0-b84a-ed1bd9c15828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK19800',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 101989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Style 4Motion',
 'year': 2018}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Saving data for KK19800: {'auction_closing_time': 1774885137.0, 'created_time': 1774552600.644766, 'last_price_update_time': 1774856202.253252}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK19800') HTTP/1.1" 204 0
2026-03-30 07:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Scrape type for XZ94866: 2
2026-03-30 07:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-30 07:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fca553d1-f666-5f50-9e7e-ec2e32e44e92, identifier: XZ94866
2026-03-30 07:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-30 07:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-30 07:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866 to the API
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:23:05Z',
 'fuel_type': 'diesel',
 'id': 'fca553d1-f666-5f50-9e7e-ec2e32e44e92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ94866',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 210370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 112 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Saving data for XZ94866: {'auction_closing_time': 1774884185.0, 'created_time': 1774551273.716558, 'last_price_update_time': 1774856202.777194}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ94866') HTTP/1.1" 204 0
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Scrape type for JN34969: 2
2026-03-30 07:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-30 07:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feff33d0-db5a-5395-b461-d90baf06da5e, identifier: JN34969
2026-03-30 07:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-30 07:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-30 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969 to the API
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:40:12Z',
 'fuel_type': 'diesel',
 'id': 'feff33d0-db5a-5395-b461-d90baf06da5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34969',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 213374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-22',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Saving data for JN34969: {'auction_closing_time': 1774885212.0, 'created_time': 1774550446.412514, 'last_price_update_time': 1774856203.248689}
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN34969') HTTP/1.1" 204 0
2026-03-30 07:36:43 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-30 07:36:43 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-30 07:36:43 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Scrape type for EW47494: 2
2026-03-30 07:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-30 07:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-30 07:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-30 07:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0254ced-9dd2-5ce9-b53b-ad62a87b550a, identifier: EW47494
2026-03-30 07:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-30 07:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-30 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494 to the API
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:52:15Z',
 'fuel_type': 'petrol',
 'id': 'c0254ced-9dd2-5ce9-b53b-ad62a87b550a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW47494',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 129008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-20',
 'seller_name': None,
 'title': 'Opel Signum 2.2 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2005}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Saving data for EW47494: {'auction_closing_time': 1774885935.0, 'created_time': 1773773421.528833, 'last_price_update_time': 1774856204.064687}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW47494') HTTP/1.1" 204 0
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-30 07:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:46 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 7658 | hits on page: 40
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for RF79085: 2
2026-03-30 07:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-30 07:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ff71619-8f0b-5390-9647-6cc527d31ac0, identifier: RF79085
2026-03-30 07:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-30 07:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-30 07:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085 to the API
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:27:33Z',
 'fuel_type': 'diesel',
 'id': '1ff71619-8f0b-5390-9647-6cc527d31ac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF79085',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 120057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2020}
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Saving data for RF79085: {'auction_closing_time': 1774884453.0, 'created_time': 1773946273.632111, 'last_price_update_time': 1774856206.580526}
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF79085') HTTP/1.1" 204 0
2026-03-30 07:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for KX50860: 2
2026-03-30 07:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-30 07:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd, identifier: KX50860
2026-03-30 07:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-30 07:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-30 07:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860 to the API
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:07:38Z',
 'fuel_type': 'diesel',
 'id': 'f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX50860',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 229208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2012}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Saving data for KX50860: {'auction_closing_time': 1774883258.0, 'created_time': 1774552609.02483, 'last_price_update_time': 1774856207.082541}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX50860') HTTP/1.1" 204 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for RU25678: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for GV09290: 2
2026-03-30 07:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-30 07:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c633b2a0-7b9d-5b03-a832-d699cff4719e, identifier: GV09290
2026-03-30 07:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-30 07:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-30 07:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290 to the API
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:33Z',
 'fuel_type': 'petrol',
 'id': 'c633b2a0-7b9d-5b03-a832-d699cff4719e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV09290',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 39195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ice 4x2',
 'transmission': 'manual',
 'trim': 'Ice 4x2',
 'year': 2016}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Saving data for GV09290: {'auction_closing_time': 1774883673.0, 'created_time': 1773946114.099924, 'last_price_update_time': 1774856207.700413}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV09290') HTTP/1.1" 204 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for KL90594: 2
2026-03-30 07:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-30 07:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7387eab6-ccc2-52fe-a102-476781e38c0f, identifier: KL90594
2026-03-30 07:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-30 07:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-30 07:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594 to the API
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:36:13Z',
 'fuel_type': 'petrol',
 'id': '7387eab6-ccc2-52fe-a102-476781e38c0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL90594',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 156915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-15',
 'seller_name': None,
 'title': 'Daihatsu Terios 1.5 Top 4WD',
 'transmission': 'manual',
 'trim': 'Top 4WD',
 'year': 2009}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [auto1.de] INFO: Saving data for KL90594: {'auction_closing_time': 1774884973.0, 'created_time': 1774550494.914282, 'last_price_update_time': 1774856208.262859}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL90594') HTTP/1.1" 204 0
2026-03-30 07:36:48 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 07:36:48 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 07:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:50 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 7664 | hits on page: 40
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for DX01657: 2
2026-03-30 07:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-30 07:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88730801-e705-5c42-a028-601e950fcf63, identifier: DX01657
2026-03-30 07:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-30 07:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-30 07:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657 to the API
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:45:04Z',
 'fuel_type': 'hybrid',
 'id': '88730801-e705-5c42-a028-601e950fcf63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX01657',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 161770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-14',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Life+',
 'transmission': 'automatic',
 'trim': 'Life+',
 'year': 2013}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Saving data for DX01657: {'auction_closing_time': 1774885504.0, 'created_time': 1773916814.054608, 'last_price_update_time': 1774856210.823749}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX01657') HTTP/1.1" 204 0
2026-03-30 07:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for KV78740: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:52 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 7665 | hits on page: 40
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for JR17780: 2
2026-03-30 07:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-30 07:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-30 07:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-30 07:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc, identifier: JR17780
2026-03-30 07:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-30 07:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-30 07:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780 to the API
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:36:05Z',
 'fuel_type': 'petrol',
 'id': '68c9a3cd-3f7d-5323-94bf-c8e96811cdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17780',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 129260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-11',
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Saving data for JR17780: {'auction_closing_time': 1774884965.0, 'created_time': 1774552907.746601, 'last_price_update_time': 1774856212.973}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR17780') HTTP/1.1" 204 0
2026-03-30 07:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 07:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:54 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 7667 | hits on page: 40
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-30 07:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:55 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 7667 | hits on page: 40
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Scrape type for BR02307: 2
2026-03-30 07:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-30 07:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9fc1597-97d9-5093-981f-75f1459966f8, identifier: BR02307
2026-03-30 07:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-30 07:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-30 07:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307 to the API
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'petrol',
 'id': 'c9fc1597-97d9-5093-981f-75f1459966f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02307',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-21',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Saving data for BR02307: {'auction_closing_time': 1774884887.0, 'created_time': 1774551478.276678, 'last_price_update_time': 1774856216.25894}
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02307') HTTP/1.1" 204 0
2026-03-30 07:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for CL06528: 2
2026-03-30 07:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-30 07:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-30 07:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261adc2e-1e99-5a6c-8d56-f9d4e5203628, identifier: CL06528
2026-03-30 07:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-30 07:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-30 07:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528 to the API
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:46:42Z',
 'fuel_type': 'petrol',
 'id': '261adc2e-1e99-5a6c-8d56-f9d4e5203628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL06528',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 49971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2019}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Saving data for CL06528: {'auction_closing_time': 1774885602.0, 'created_time': 1773945708.047113, 'last_price_update_time': 1774856217.251243}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL06528') HTTP/1.1" 204 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for UC38867: 2
2026-03-30 07:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-30 07:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-30 07:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-30 07:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0bd1214-59f8-57e2-a2df-20914b0eb727, identifier: UC38867
2026-03-30 07:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-30 07:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-30 07:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867 to the API
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:07Z',
 'fuel_type': 'petrol',
 'id': 'f0bd1214-59f8-57e2-a2df-20914b0eb727',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC38867',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 30640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Saving data for UC38867: {'auction_closing_time': 1774883827.0, 'created_time': 1774552144.218025, 'last_price_update_time': 1774856217.868568}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC38867') HTTP/1.1" 204 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-30 07:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:00 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 7674 | hits on page: 40
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for FM53272: 2
2026-03-30 07:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-30 07:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec, identifier: FM53272
2026-03-30 07:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-30 07:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-30 07:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272 to the API
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:48Z',
 'fuel_type': 'petrol',
 'id': '2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM53272',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 136115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Saving data for FM53272: {'auction_closing_time': 1774885908.0, 'created_time': 1774553014.077737, 'last_price_update_time': 1774856220.681651}
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM53272') HTTP/1.1" 204 0
2026-03-30 07:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for AZ05535: 2
2026-03-30 07:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-30 07:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a20cfbd8-21a1-517b-8f4c-760298d93660, identifier: AZ05535
2026-03-30 07:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-30 07:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-30 07:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535 to the API
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-30T15:10:26Z',
 'fuel_type': 'petrol',
 'id': 'a20cfbd8-21a1-517b-8f4c-760298d93660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ05535',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 95046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 500 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Saving data for AZ05535: {'auction_closing_time': 1774883426.0, 'created_time': 1774551038.547434, 'last_price_update_time': 1774856221.326632}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ05535') HTTP/1.1" 204 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for FH94786: 2
2026-03-30 07:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-30 07:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31706614-c4a9-57f0-8950-068b251b4247, identifier: FH94786
2026-03-30 07:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-30 07:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-30 07:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786 to the API
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:58Z',
 'fuel_type': 'diesel',
 'id': '31706614-c4a9-57f0-8950-068b251b4247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH94786',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 88716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2015}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Saving data for FH94786: {'auction_closing_time': 1774884658.0, 'created_time': 1773945700.262138, 'last_price_update_time': 1774856221.928275}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH94786') HTTP/1.1" 204 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 07:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:03 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 7681 | hits on page: 40
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for XN70423: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-30 07:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:04 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 7685 | hits on page: 40
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for MA41049: 2
2026-03-30 07:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-30 07:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-30 07:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6f7744-257d-5670-8a10-caf34f145406, identifier: MA41049
2026-03-30 07:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-30 07:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-30 07:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049 to the API
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'diesel',
 'id': '0f6f7744-257d-5670-8a10-caf34f145406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA41049',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 109518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Saving data for MA41049: {'auction_closing_time': 1774882839.0, 'created_time': 1774552850.297774, 'last_price_update_time': 1774856225.37078}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA41049') HTTP/1.1" 204 0
2026-03-30 07:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for WJ04835: 2
2026-03-30 07:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-30 07:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-30 07:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e53c585-b8c2-588f-a3f7-daeb8cda5687, identifier: WJ04835
2026-03-30 07:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-30 07:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-30 07:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835 to the API
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:53:28Z',
 'fuel_type': 'petrol',
 'id': '2e53c585-b8c2-588f-a3f7-daeb8cda5687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ04835',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 79386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Saving data for WJ04835: {'auction_closing_time': 1774886008.0, 'created_time': 1774552975.791394, 'last_price_update_time': 1774856225.856787}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ04835') HTTP/1.1" 204 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for LT09542: 2
2026-03-30 07:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-30 07:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-30 07:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-30 07:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1, identifier: LT09542
2026-03-30 07:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-30 07:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-30 07:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542 to the API
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:49Z',
 'fuel_type': 'diesel',
 'id': 'eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09542',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 66378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.2 DI-D Intro Edition Doppelkabine 4WD',
 'transmission': 'manual',
 'trim': 'Intro Edition Doppelkabine 4WD',
 'year': 2021}
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Saving data for LT09542: {'auction_closing_time': 1774884049.0, 'created_time': 1774552104.025224, 'last_price_update_time': 1774856226.46004}
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT09542') HTTP/1.1" 204 0
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 07:37:06 [scrapy.extensions.logstats] INFO: Crawled 265 pages (at 21 pages/min), scraped 410 items (at 44 items/min)
2026-03-30 07:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:07 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 7688 | hits on page: 40
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for AR62221: 2
2026-03-30 07:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-30 07:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52880e4b-6cad-5a97-b17e-99a4cc2755c5, identifier: AR62221
2026-03-30 07:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-30 07:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-30 07:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221 to the API
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:26:47Z',
 'fuel_type': 'petrol',
 'id': '52880e4b-6cad-5a97-b17e-99a4cc2755c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR62221',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Saving data for AR62221: {'auction_closing_time': 1774884407.0, 'created_time': 1774552431.811963, 'last_price_update_time': 1774856228.159952}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR62221') HTTP/1.1" 204 0
2026-03-30 07:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-30 07:37:08 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 07:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:09 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 7690 | hits on page: 40
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for PL23541: 2
2026-03-30 07:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-30 07:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-30 07:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd, identifier: PL23541
2026-03-30 07:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-30 07:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-30 07:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541 to the API
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:26Z',
 'fuel_type': 'petrol',
 'id': '2aa0930a-4fd3-55bd-a021-cb148c9dfebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL23541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 236601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Saving data for PL23541: {'auction_closing_time': 1774883426.0, 'created_time': 1774552679.213452, 'last_price_update_time': 1774856229.730432}
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL23541') HTTP/1.1" 204 0
2026-03-30 07:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for XB46016: 2
2026-03-30 07:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-30 07:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-30 07:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f84f96fd-058d-50a7-910f-d3b395067d18, identifier: XB46016
2026-03-30 07:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-30 07:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-30 07:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016 to the API
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:14Z',
 'fuel_type': 'diesel',
 'id': 'f84f96fd-058d-50a7-910f-d3b395067d18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB46016',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 238510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-11',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Saving data for XB46016: {'auction_closing_time': 1774885994.0, 'created_time': 1773916340.451143, 'last_price_update_time': 1774856230.399578}
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB46016') HTTP/1.1" 204 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 07:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:11 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 7691 | hits on page: 40
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-30 07:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:13 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 7691 | hits on page: 40
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-30 07:37:13 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Scrape type for WE79254: 2
2026-03-30 07:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-30 07:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-30 07:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-30 07:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39ebb7c2-9354-5580-a69b-c618da39f6c0, identifier: WE79254
2026-03-30 07:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-30 07:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-30 07:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254 to the API
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:24Z',
 'fuel_type': 'petrol',
 'id': '39ebb7c2-9354-5580-a69b-c618da39f6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE79254',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 171097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Saving data for WE79254: {'auction_closing_time': 1774883844.0, 'created_time': 1774552896.025092, 'last_price_update_time': 1774856234.179873}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE79254') HTTP/1.1" 204 0
2026-03-30 07:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-30 07:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:15 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 7694 | hits on page: 40
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for AW88722: 0
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for YT16808: 2
2026-03-30 07:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-30 07:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1, identifier: YT16808
2026-03-30 07:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-30 07:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-30 07:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808 to the API
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:11Z',
 'fuel_type': 'diesel',
 'id': 'c54da2d6-baf8-5f1d-a15b-3027cc45c2d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 121361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Saving data for YT16808: {'auction_closing_time': 1774886291.0, 'created_time': 1774552583.184309, 'last_price_update_time': 1774856235.834263}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT16808') HTTP/1.1" 204 0
2026-03-30 07:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-30 07:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:26 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 7717 | hits on page: 40
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for DF95353: 2
2026-03-30 07:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-30 07:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b73d08a5-dd75-5f7c-9eca-e6714f372d56, identifier: DF95353
2026-03-30 07:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-30 07:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-30 07:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353 to the API
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:39:04Z',
 'fuel_type': 'petrol',
 'id': 'b73d08a5-dd75-5f7c-9eca-e6714f372d56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF95353',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 76657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2021}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Saving data for DF95353: {'auction_closing_time': 1774885144.0, 'created_time': 1774552505.025691, 'last_price_update_time': 1774856246.876909}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF95353') HTTP/1.1" 204 0
2026-03-30 07:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 07:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:31 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 7720 | hits on page: 40
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 07:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:33 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 7721 | hits on page: 40
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for BN76417: 2
2026-03-30 07:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-30 07:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb558e6-ec59-5f85-9dae-a97bfbeff81f, identifier: BN76417
2026-03-30 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-30 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-30 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417 to the API
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:23Z',
 'fuel_type': 'petrol',
 'id': 'fbb558e6-ec59-5f85-9dae-a97bfbeff81f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN76417',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 175143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2013}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Saving data for BN76417: {'auction_closing_time': 1774885523.0, 'created_time': 1774552639.452933, 'last_price_update_time': 1774856253.574346}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN76417') HTTP/1.1" 204 0
2026-03-30 07:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for AW08292: 2
2026-03-30 07:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-30 07:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074, identifier: AW08292
2026-03-30 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-30 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-30 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292 to the API
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:13:35Z',
 'fuel_type': 'diesel',
 'id': '3d56433f-ccf3-56e8-97fc-ee5a95ef3074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW08292',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 244577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Life 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Saving data for AW08292: {'auction_closing_time': 1774883615.0, 'created_time': 1774589448.774175, 'last_price_update_time': 1774856254.144769}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW08292') HTTP/1.1" 204 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for LT29180: 2
2026-03-30 07:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-30 07:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-30 07:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-30 07:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a, identifier: LT29180
2026-03-30 07:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-30 07:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-30 07:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180 to the API
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:08Z',
 'fuel_type': 'petrol',
 'id': '40b4d1f6-4b6e-5b78-9f54-c6c8b553980a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT29180',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 263326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-09',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Saving data for LT29180: {'auction_closing_time': 1774883828.0, 'created_time': 1774551841.295708, 'last_price_update_time': 1774856254.613685}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT29180') HTTP/1.1" 204 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 07:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:35 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 7724 | hits on page: 40
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for KR99013: 2
2026-03-30 07:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-30 07:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-30 07:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-30 07:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94dc017-64c8-56df-95f3-24eb36c7e3f6, identifier: KR99013
2026-03-30 07:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-30 07:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-30 07:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013 to the API
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:32Z',
 'fuel_type': 'petrol',
 'id': 'b94dc017-64c8-56df-95f3-24eb36c7e3f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR99013',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 100815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-20',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2022}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Saving data for KR99013: {'auction_closing_time': 1774884872.0, 'created_time': 1774552737.954617, 'last_price_update_time': 1774856256.289965}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR99013') HTTP/1.1" 204 0
2026-03-30 07:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 07:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:37 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 7727 | hits on page: 40
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for DC50657: 2
2026-03-30 07:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-30 07:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1, identifier: DC50657
2026-03-30 07:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-30 07:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-30 07:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657 to the API
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'petrol',
 'id': 'fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC50657',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 94991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Saving data for DC50657: {'auction_closing_time': 1774886342.0, 'created_time': 1774553087.557671, 'last_price_update_time': 1774856258.164022}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC50657') HTTP/1.1" 204 0
2026-03-30 07:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for EL91395: 2
2026-03-30 07:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-30 07:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-30 07:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-30 07:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c25ffd9d-22a1-58fc-ac48-e6acaac22652, identifier: EL91395
2026-03-30 07:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-30 07:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-30 07:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395 to the API
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:01:07Z',
 'fuel_type': 'petrol',
 'id': 'c25ffd9d-22a1-58fc-ac48-e6acaac22652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91395',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 101206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-12',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Spirit",
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2016}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Saving data for EL91395: {'auction_closing_time': 1774882867.0, 'created_time': 1774550835.454221, 'last_price_update_time': 1774856258.833963}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91395') HTTP/1.1" 204 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 07:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:40 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 7731 | hits on page: 40
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for NJ99986: 2
2026-03-30 07:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-30 07:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b88148ba-1898-5d41-99ee-1a21693766b2, identifier: NJ99986
2026-03-30 07:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-30 07:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-30 07:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986 to the API
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:39:23Z',
 'fuel_type': 'petrol',
 'id': 'b88148ba-1898-5d41-99ee-1a21693766b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ99986',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 43974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Saving data for NJ99986: {'auction_closing_time': 1774885163.0, 'created_time': 1774550451.941016, 'last_price_update_time': 1774856260.639234}
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ99986') HTTP/1.1" 204 0
2026-03-30 07:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for PJ34004: 2
2026-03-30 07:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-30 07:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9, identifier: PJ34004
2026-03-30 07:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-30 07:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-30 07:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004 to the API
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:30:46Z',
 'fuel_type': 'petrol',
 'id': 'f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34004',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 27315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Ti Q4',
 'transmission': 'automatic',
 'trim': 'Ti Q4',
 'year': 2024}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Saving data for PJ34004: {'auction_closing_time': 1774884646.0, 'created_time': 1773945651.002095, 'last_price_update_time': 1774856261.245283}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34004') HTTP/1.1" 204 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 07:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:42 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 7734 | hits on page: 40
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 07:37:42 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Scrape type for EU79634: 2
2026-03-30 07:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-30 07:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-30 07:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-30 07:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978faa5d-a950-51ce-af1a-d25f2c2e3856, identifier: EU79634
2026-03-30 07:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-30 07:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-30 07:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634 to the API
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:13Z',
 'fuel_type': 'petrol',
 'id': '978faa5d-a950-51ce-af1a-d25f2c2e3856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU79634',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 229267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Saving data for EU79634: {'auction_closing_time': 1774884733.0, 'created_time': 1774550403.534053, 'last_price_update_time': 1774856262.982391}
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU79634') HTTP/1.1" 204 0
2026-03-30 07:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for KJ96980: 2
2026-03-30 07:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-30 07:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d, identifier: KJ96980
2026-03-30 07:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-30 07:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-30 07:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980 to the API
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:14:34Z',
 'fuel_type': 'diesel',
 'id': '275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 176538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Saving data for KJ96980: {'auction_closing_time': 1774883674.0, 'created_time': 1774550869.884903, 'last_price_update_time': 1774856263.517838}
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ96980') HTTP/1.1" 204 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for BJ98180: 2
2026-03-30 07:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-30 07:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67f938a2-302a-502b-8ae2-c5bd24720d71, identifier: BJ98180
2026-03-30 07:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-30 07:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-30 07:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180 to the API
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:08Z',
 'fuel_type': 'diesel',
 'id': '67f938a2-302a-502b-8ae2-c5bd24720d71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ98180',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 313282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2019}
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Saving data for BJ98180: {'auction_closing_time': 1774883108.0, 'created_time': 1773916500.862034, 'last_price_update_time': 1774856264.476264}
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ98180') HTTP/1.1" 204 0
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Scrape type for RZ53370: 2
2026-03-30 07:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-30 07:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-30 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-30 07:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2b8648-900e-5999-addd-3e659c7d098c, identifier: RZ53370
2026-03-30 07:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-30 07:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-30 07:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370 to the API
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:03:54Z',
 'fuel_type': 'petrol',
 'id': 'af2b8648-900e-5999-addd-3e659c7d098c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ53370',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 102589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Saving data for RZ53370: {'auction_closing_time': 1774883034.0, 'created_time': 1774553029.767081, 'last_price_update_time': 1774856265.050381}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ53370') HTTP/1.1" 204 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-30 07:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:46 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 7739 | hits on page: 40
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-30 07:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:47 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 7740 | hits on page: 40
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Scrape type for AH65179: 2
2026-03-30 07:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-30 07:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-30 07:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-30 07:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9, identifier: AH65179
2026-03-30 07:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-30 07:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-30 07:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179 to the API
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 58734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Saving data for AH65179: {'auction_closing_time': 1774884037.0, 'created_time': 1774552745.370481, 'last_price_update_time': 1774856267.986472}
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65179') HTTP/1.1" 204 0
2026-03-30 07:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for HW81308: 2
2026-03-30 07:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-30 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2, identifier: HW81308
2026-03-30 07:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-30 07:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-30 07:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308 to the API
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:23:22Z',
 'fuel_type': 'diesel',
 'id': '2e0e4d35-ff94-585f-9cf7-db4ab8340fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW81308',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 168377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-30 07:37:49 [auto1.de] INFO: Saving data for HW81308: {'auction_closing_time': 1774884202.0, 'created_time': 1773945909.447446, 'last_price_update_time': 1774856269.00694}
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW81308') HTTP/1.1" 204 0
2026-03-30 07:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:50 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 7748 | hits on page: 40
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for RJ76690: 2
2026-03-30 07:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-30 07:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0, identifier: RJ76690
2026-03-30 07:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-30 07:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-30 07:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690 to the API
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:13Z',
 'fuel_type': 'petrol',
 'id': '28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ76690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 53943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Saving data for RJ76690: {'auction_closing_time': 1774882873.0, 'created_time': 1774552305.477944, 'last_price_update_time': 1774856270.638992}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ76690') HTTP/1.1" 204 0
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-30 07:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:52 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 7753 | hits on page: 40
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for BZ53185: 2
2026-03-30 07:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-30 07:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0166d2-96c1-5251-8dba-566ecfb302d7, identifier: BZ53185
2026-03-30 07:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-30 07:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-30 07:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185 to the API
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '8a0166d2-96c1-5251-8dba-566ecfb302d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ53185',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 143387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Saving data for BZ53185: {'auction_closing_time': 1774883190.0, 'created_time': 1774552829.885699, 'last_price_update_time': 1774856272.712165}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ53185') HTTP/1.1" 204 0
2026-03-30 07:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:53 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 7757 | hits on page: 40
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: US02373
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for ZW22458: 2
2026-03-30 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-30 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-30 07:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e574e2-962c-5b6f-b0f1-ce629fe943b7, identifier: ZW22458
2026-03-30 07:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-30 07:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-30 07:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458 to the API
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:30:58Z',
 'fuel_type': 'petrol',
 'id': '27e574e2-962c-5b6f-b0f1-ce629fe943b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW22458',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 106309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-12',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2018}
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Saving data for ZW22458: {'auction_closing_time': 1774884658.0, 'created_time': 1774550419.867046, 'last_price_update_time': 1774856274.434999}
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW22458') HTTP/1.1" 204 0
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:55 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 7761 | hits on page: 40
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 07:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:01 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 7769 | hits on page: 40
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for WR53064: 2
2026-03-30 07:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-30 07:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb153bde-d42a-5581-83ea-3a0cd6c4c086, identifier: WR53064
2026-03-30 07:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-30 07:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-30 07:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064 to the API
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'fb153bde-d42a-5581-83ea-3a0cd6c4c086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR53064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 162720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Saving data for WR53064: {'auction_closing_time': 1774883404.0, 'created_time': 1774550635.424659, 'last_price_update_time': 1774856282.615611}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR53064') HTTP/1.1" 204 0
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for UY95441: 2
2026-03-30 07:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-30 07:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-30 07:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2, identifier: UY95441
2026-03-30 07:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-30 07:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-30 07:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441 to the API
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:55Z',
 'fuel_type': 'petrol',
 'id': '3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95441',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 137738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-12',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2005}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Saving data for UY95441: {'auction_closing_time': 1774883335.0, 'created_time': 1773916862.210946, 'last_price_update_time': 1774856283.299847}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY95441') HTTP/1.1" 204 0
2026-03-30 07:38:03 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-30 07:38:03 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-30 07:38:03 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-30 07:38:03 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-30 07:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:05 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 7770 | hits on page: 40
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for EB22696: 2
2026-03-30 07:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-30 07:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-30 07:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d10e40-832c-54a6-8225-7b5773fad699, identifier: EB22696
2026-03-30 07:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-30 07:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-30 07:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696 to the API
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:40:44Z',
 'fuel_type': 'petrol',
 'id': '28d10e40-832c-54a6-8225-7b5773fad699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB22696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 175697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Saving data for EB22696: {'auction_closing_time': 1774885244.0, 'created_time': 1774550458.973322, 'last_price_update_time': 1774856286.152487}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB22696') HTTP/1.1" 204 0
2026-03-30 07:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for FJ40863: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-30 07:38:06 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 20 pages/min), scraped 436 items (at 26 items/min)
2026-03-30 07:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:07 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 7773 | hits on page: 40
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for EH98635: 2
2026-03-30 07:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-30 07:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-30 07:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a653b3-bfc7-5242-b232-61b7f69943ee, identifier: EH98635
2026-03-30 07:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-30 07:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-30 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635 to the API
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'diesel',
 'id': 'b7a653b3-bfc7-5242-b232-61b7f69943ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH98635',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 247631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2011}
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Saving data for EH98635: {'auction_closing_time': 1774885299.0, 'created_time': 1774552675.16393, 'last_price_update_time': 1774856287.969322}
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH98635') HTTP/1.1" 204 0
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for XM85964: 2
2026-03-30 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-30 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313, identifier: XM85964
2026-03-30 07:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-30 07:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-30 07:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964 to the API
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:43Z',
 'fuel_type': 'petrol',
 'id': '5aa1c1e8-fc29-5b3a-8624-31a1592c0313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM85964',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 142072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Saving data for XM85964: {'auction_closing_time': 1774883803.0, 'created_time': 1774550453.994882, 'last_price_update_time': 1774856288.755443}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM85964') HTTP/1.1" 204 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 07:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:09 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 7780 | hits on page: 40
2026-03-30 07:38:09 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-30 07:38:09 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 07:38:09 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-30 07:38:09 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-30 07:38:09 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 07:38:10 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-30 07:38:10 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 07:38:10 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 07:38:10 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 07:38:10 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 07:38:10 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-30 07:38:10 [auto1.de] INFO: Scrape type for DW20402: 2
2026-03-30 07:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-30 07:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-30 07:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-30 07:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed, identifier: DW20402
2026-03-30 07:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-30 07:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-30 07:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402 to the API
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:18:56Z',
 'fuel_type': 'petrol',
 'id': '47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW20402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 85484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-30 07:38:10 [auto1.de] INFO: Saving data for DW20402: {'auction_closing_time': 1774883936.0, 'created_time': 1774551198.614287, 'last_price_update_time': 1774856290.954398}
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW20402') HTTP/1.1" 204 0
2026-03-30 07:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for AU06034: 2
2026-03-30 07:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-30 07:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-30 07:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0ce9e7a-d909-5e79-836f-98ded9635476, identifier: AU06034
2026-03-30 07:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-30 07:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-30 07:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034 to the API
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:10Z',
 'fuel_type': 'diesel',
 'id': 'e0ce9e7a-d909-5e79-836f-98ded9635476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU06034',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 49012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Saving data for AU06034: {'auction_closing_time': 1774884010.0, 'created_time': 1774550400.677971, 'last_price_update_time': 1774856291.527676}
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU06034') HTTP/1.1" 204 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for KG01306: 2
2026-03-30 07:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-30 07:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-30 07:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6614e19-e614-5e2b-920a-95a00d82c0f5, identifier: KG01306
2026-03-30 07:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-30 07:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-30 07:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306 to the API
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:20:10Z',
 'fuel_type': 'diesel',
 'id': 'a6614e19-e614-5e2b-920a-95a00d82c0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG01306',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 99457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Acenta 4x4',
 'transmission': 'manual',
 'trim': 'Acenta 4x4',
 'year': 2017}
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Saving data for KG01306: {'auction_closing_time': 1774884010.0, 'created_time': 1774552928.753283, 'last_price_update_time': 1774856291.997895}
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG01306') HTTP/1.1" 204 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 07:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:13 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 7783 | hits on page: 40
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for ZF45936: 2
2026-03-30 07:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-30 07:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-30 07:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e, identifier: ZF45936
2026-03-30 07:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-30 07:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-30 07:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936 to the API
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'petrol',
 'id': '9d33e5ad-e765-5837-b46a-c3f52bd04b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF45936',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2020}
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Saving data for ZF45936: {'auction_closing_time': 1774883987.0, 'created_time': 1774550428.152798, 'last_price_update_time': 1774856293.870208}
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF45936') HTTP/1.1" 204 0
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for GK14526: 2
2026-03-30 07:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-30 07:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-30 07:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86b4209c-70c6-54ea-a56c-594112fb4f69, identifier: GK14526
2026-03-30 07:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-30 07:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-30 07:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526 to the API
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:16Z',
 'fuel_type': 'diesel',
 'id': '86b4209c-70c6-54ea-a56c-594112fb4f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK14526',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 212247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-09',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Saving data for GK14526: {'auction_closing_time': 1774885216.0, 'created_time': 1774552979.639552, 'last_price_update_time': 1774856294.452944}
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK14526') HTTP/1.1" 204 0
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-30 07:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:15 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 7788 | hits on page: 40
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for VY10701: 2
2026-03-30 07:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-30 07:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-30 07:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28341f4f-64c1-54f7-96fc-3050898b0c78, identifier: VY10701
2026-03-30 07:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-30 07:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-30 07:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701 to the API
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'diesel',
 'id': '28341f4f-64c1-54f7-96fc-3050898b0c78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY10701',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 95881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Saving data for VY10701: {'auction_closing_time': 1774885275.0, 'created_time': 1774550721.033124, 'last_price_update_time': 1774856295.96079}
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY10701') HTTP/1.1" 204 0
2026-03-30 07:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-30 07:38:16 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-30 07:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:17 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 7793 | hits on page: 40
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-30 07:38:17 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-30 07:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:20 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 7793 | hits on page: 40
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for JA27410: 2
2026-03-30 07:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-30 07:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-30 07:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcabcd04-cbe2-541d-93d7-8eda73afcd0e, identifier: JA27410
2026-03-30 07:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-30 07:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-30 07:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410 to the API
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:13:21Z',
 'fuel_type': 'petrol',
 'id': 'dcabcd04-cbe2-541d-93d7-8eda73afcd0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA27410',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 73032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'BMW 5er 540i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Saving data for JA27410: {'auction_closing_time': 1774883601.0, 'created_time': 1774552958.941099, 'last_price_update_time': 1774856300.736941}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA27410') HTTP/1.1" 204 0
2026-03-30 07:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for UZ18000: 2
2026-03-30 07:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-30 07:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-30 07:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5fcae3b-e4de-54a3-b145-39c0cd683378, identifier: UZ18000
2026-03-30 07:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-30 07:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-30 07:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000 to the API
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:37:08Z',
 'fuel_type': 'petrol',
 'id': 'd5fcae3b-e4de-54a3-b145-39c0cd683378',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ18000',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 163026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Saving data for UZ18000: {'auction_closing_time': 1774885028.0, 'created_time': 1774552707.478726, 'last_price_update_time': 1774856301.344457}
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ18000') HTTP/1.1" 204 0
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-30 07:38:21 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Scrape type for SP10059: 2
2026-03-30 07:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-30 07:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-30 07:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a, identifier: SP10059
2026-03-30 07:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-30 07:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-30 07:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059 to the API
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:03Z',
 'fuel_type': 'petrol',
 'id': '8227b11b-d940-5c87-9b9b-f6735ec5ef9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP10059',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 140553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Saving data for SP10059: {'auction_closing_time': 1774882983.0, 'created_time': 1774550554.364328, 'last_price_update_time': 1774856302.173138}
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP10059') HTTP/1.1" 204 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-30 07:38:22 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:23 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 7797 | hits on page: 40
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for CS57817: 2
2026-03-30 07:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-30 07:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-30 07:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-30 07:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b023d71d-53b9-5e8f-a193-0eaa1d56b699, identifier: CS57817
2026-03-30 07:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-30 07:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-30 07:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817 to the API
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:39:46Z',
 'fuel_type': 'petrol',
 'id': 'b023d71d-53b9-5e8f-a193-0eaa1d56b699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS57817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 158560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Saving data for CS57817: {'auction_closing_time': 1774885186.0, 'created_time': 1774550632.523109, 'last_price_update_time': 1774856303.96483}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS57817') HTTP/1.1" 204 0
2026-03-30 07:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: US71241
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for US71241: 2
2026-03-30 07:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-30 07:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-30 07:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd, identifier: US71241
2026-03-30 07:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-30 07:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-30 07:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241 to the API
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:20:20Z',
 'fuel_type': 'petrol',
 'id': '10f50ef8-9aba-5924-bcc2-b05fb5cf08dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US71241',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 182817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-29',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2013}
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Saving data for US71241: {'auction_closing_time': 1774884020.0, 'created_time': 1774552152.038279, 'last_price_update_time': 1774856304.665801}
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US71241') HTTP/1.1" 204 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:25 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 7802 | hits on page: 40
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for KG29776: 2
2026-03-30 07:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-30 07:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-30 07:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d079a9b2-1b71-51ff-b51c-3deea7ea11cf, identifier: KG29776
2026-03-30 07:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-30 07:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-30 07:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776 to the API
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'diesel',
 'id': 'd079a9b2-1b71-51ff-b51c-3deea7ea11cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG29776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 125633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Saving data for KG29776: {'auction_closing_time': 1774884797.0, 'created_time': 1774552135.12405, 'last_price_update_time': 1774856306.32521}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG29776') HTTP/1.1" 204 0
2026-03-30 07:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-30 07:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:27 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 7803 | hits on page: 40
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-30 07:38:27 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [auto1.de] INFO: Scrape type for CA27289: 2
2026-03-30 07:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-30 07:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-30 07:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743eaa40-a042-5c85-8147-f1fd9798a2ef, identifier: CA27289
2026-03-30 07:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-30 07:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-30 07:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289 to the API
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'petrol',
 'id': '743eaa40-a042-5c85-8147-f1fd9798a2ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA27289',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 100623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Saving data for CA27289: {'auction_closing_time': 1774884382.0, 'created_time': 1774552109.659611, 'last_price_update_time': 1774856308.046865}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA27289') HTTP/1.1" 204 0
2026-03-30 07:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for YD60070: 2
2026-03-30 07:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-30 07:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-30 07:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d97d0e12-9ca1-581c-a761-e4df19eef248, identifier: YD60070
2026-03-30 07:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-30 07:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-30 07:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070 to the API
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:11:11Z',
 'fuel_type': 'petrol',
 'id': 'd97d0e12-9ca1-581c-a761-e4df19eef248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD60070',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 48763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Saving data for YD60070: {'auction_closing_time': 1774883471.0, 'created_time': 1774552186.469334, 'last_price_update_time': 1774856308.571708}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD60070') HTTP/1.1" 204 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 07:38:28 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:29 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 7805 | hits on page: 40
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-30 07:38:29 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Scrape type for MA44978: 2
2026-03-30 07:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-30 07:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-30 07:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f785a168-36e5-57c6-9138-cf3c9e01bf69, identifier: MA44978
2026-03-30 07:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-30 07:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-30 07:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978 to the API
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:13Z',
 'fuel_type': 'diesel',
 'id': 'f785a168-36e5-57c6-9138-cf3c9e01bf69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA44978',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 186405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-23',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-30 07:38:30 [auto1.de] INFO: Saving data for MA44978: {'auction_closing_time': 1774884553.0, 'created_time': 1774550639.849563, 'last_price_update_time': 1774856310.42287}
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA44978') HTTP/1.1" 204 0
2026-03-30 07:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:30 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-30 07:38:30 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-30 07:38:30 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-30 07:38:30 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-30 07:38:30 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-30 07:38:30 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-30 07:38:30 [auto1.de] INFO: Scrape type for CX62190: 2
2026-03-30 07:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-30 07:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-30 07:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d, identifier: CX62190
2026-03-30 07:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-30 07:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-30 07:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190 to the API
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:11Z',
 'fuel_type': 'diesel',
 'id': 'bf8ae8c4-7d81-5714-9717-d9aaaae0d43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX62190',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 123390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [auto1.de] INFO: Saving data for CX62190: {'auction_closing_time': 1774884011.0, 'created_time': 1773917593.046965, 'last_price_update_time': 1774856311.450757}
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX62190') HTTP/1.1" 204 0
2026-03-30 07:38:31 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [auto1.de] INFO: Scrape type for RE06888: 2
2026-03-30 07:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-30 07:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-30 07:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d18c2ef2-1803-574c-94da-7ec485fa67d7, identifier: RE06888
2026-03-30 07:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-30 07:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-30 07:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888 to the API
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:49Z',
 'fuel_type': 'petrol',
 'id': 'd18c2ef2-1803-574c-94da-7ec485fa67d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE06888',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 74009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [auto1.de] INFO: Saving data for RE06888: {'auction_closing_time': 1774882849.0, 'created_time': 1774552734.545828, 'last_price_update_time': 1774856312.08962}
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE06888') HTTP/1.1" 204 0
2026-03-30 07:38:32 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 07:38:32 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-30 07:38:32 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-30 07:38:32 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:33 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 7810 | hits on page: 40
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Scrape type for VH62706: 2
2026-03-30 07:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-30 07:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-30 07:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0daad80e-bf64-5947-9cef-59d26173ce6b, identifier: VH62706
2026-03-30 07:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-30 07:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-30 07:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706 to the API
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:57Z',
 'fuel_type': 'petrol',
 'id': '0daad80e-bf64-5947-9cef-59d26173ce6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH62706',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 149001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Saving data for VH62706: {'auction_closing_time': 1774886337.0, 'created_time': 1774550684.020558, 'last_price_update_time': 1774856314.55411}
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH62706') HTTP/1.1" 204 0
2026-03-30 07:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for EB96923: 2
2026-03-30 07:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-30 07:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-30 07:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2183a198-b484-514a-844d-ab161ab3696a, identifier: EB96923
2026-03-30 07:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-30 07:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-30 07:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923 to the API
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-30T15:54:51Z',
 'fuel_type': 'diesel',
 'id': '2183a198-b484-514a-844d-ab161ab3696a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB96923',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 113812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean',
 'transmission': 'automatic',
 'trim': 'Ocean',
 'year': 2019}
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Saving data for EB96923: {'auction_closing_time': 1774886091.0, 'created_time': 1774552618.110459, 'last_price_update_time': 1774856315.107057}
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB96923') HTTP/1.1" 204 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:36 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 7813 | hits on page: 40
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 07:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:38 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 7816 | hits on page: 40
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for TK34912: 2
2026-03-30 07:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-30 07:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-30 07:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-30 07:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d178899-534f-531c-863c-87e000d95e7f, identifier: TK34912
2026-03-30 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-30 07:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-30 07:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912 to the API
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:16:39Z',
 'fuel_type': 'diesel',
 'id': '4d178899-534f-531c-863c-87e000d95e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK34912',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 118200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-20',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2016}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Saving data for TK34912: {'auction_closing_time': 1774883799.0, 'created_time': 1774552929.629483, 'last_price_update_time': 1774856318.774375}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK34912') HTTP/1.1" 204 0
2026-03-30 07:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-30 07:38:38 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 07:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:39 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 7818 | hits on page: 40
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for ET07412: 2
2026-03-30 07:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-30 07:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-30 07:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a070bd6-ea94-505e-870a-571a35627e97, identifier: ET07412
2026-03-30 07:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-30 07:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-30 07:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412 to the API
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:14:51Z',
 'fuel_type': 'petrol',
 'id': '4a070bd6-ea94-505e-870a-571a35627e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07412',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 125817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2017}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Saving data for ET07412: {'auction_closing_time': 1774883691.0, 'created_time': 1774552568.559639, 'last_price_update_time': 1774856320.62843}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET07412') HTTP/1.1" 204 0
2026-03-30 07:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for JC65588: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 07:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:41 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 7819 | hits on page: 40
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-30 07:38:41 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-30 07:38:41 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for EU24195: 2
2026-03-30 07:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-30 07:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-30 07:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-30 07:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce, identifier: EU24195
2026-03-30 07:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-30 07:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-30 07:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195 to the API
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'diesel',
 'id': '8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU24195',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 300756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2010}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Saving data for EU24195: {'auction_closing_time': 1774883044.0, 'created_time': 1774552550.675263, 'last_price_update_time': 1774856322.453512}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU24195') HTTP/1.1" 204 0
2026-03-30 07:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for RT01969: 2
2026-03-30 07:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-30 07:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-30 07:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-30 07:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b67095-709f-5552-a472-895acbcfb0f7, identifier: RT01969
2026-03-30 07:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-30 07:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-30 07:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969 to the API
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '21b67095-709f-5552-a472-895acbcfb0f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT01969',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 158610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Saving data for RT01969: {'auction_closing_time': 1774883761.0, 'created_time': 1773945735.005559, 'last_price_update_time': 1774856323.023012}
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT01969') HTTP/1.1" 204 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 07:38:43 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-30 07:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:44 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 7821 | hits on page: 40
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for VS10261: 2
2026-03-30 07:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-30 07:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-30 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-30 07:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9be2c9a3-e875-5258-ae8c-68e48784f7ed, identifier: VS10261
2026-03-30 07:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-30 07:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-30 07:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261 to the API
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:30Z',
 'fuel_type': 'petrol',
 'id': '9be2c9a3-e875-5258-ae8c-68e48784f7ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS10261',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 27944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2019}
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Saving data for VS10261: {'auction_closing_time': 1774884750.0, 'created_time': 1774552847.417718, 'last_price_update_time': 1774856325.159427}
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS10261') HTTP/1.1" 204 0
2026-03-30 07:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-30 07:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:46 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 7823 | hits on page: 40
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-30 07:38:46 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Scrape type for AK43100: 2
2026-03-30 07:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-30 07:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-30 07:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2903661-63dd-5386-916d-5dac2dd0550f, identifier: AK43100
2026-03-30 07:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-30 07:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-30 07:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100 to the API
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:12:03Z',
 'fuel_type': 'petrol',
 'id': 'c2903661-63dd-5386-916d-5dac2dd0550f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK43100',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 183209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2011}
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Saving data for AK43100: {'auction_closing_time': 1774883523.0, 'created_time': 1774552731.178961, 'last_price_update_time': 1774856327.02336}
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK43100') HTTP/1.1" 204 0
2026-03-30 07:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 07:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:49 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 7824 | hits on page: 40
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for AA30425: 2
2026-03-30 07:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-30 07:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23688e5d-ee29-5a73-87a8-f6f328163c0d, identifier: AA30425
2026-03-30 07:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-30 07:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-30 07:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425 to the API
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:05:45Z',
 'fuel_type': 'petrol',
 'id': '23688e5d-ee29-5a73-87a8-f6f328163c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA30425',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 185160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Saving data for AA30425: {'auction_closing_time': 1774883145.0, 'created_time': 1773917341.392454, 'last_price_update_time': 1774856329.690678}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA30425') HTTP/1.1" 204 0
2026-03-30 07:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-30 07:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:51 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 7827 | hits on page: 40
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Scrape type for UE11202: 2
2026-03-30 07:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-30 07:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-30 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-30 07:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722, identifier: UE11202
2026-03-30 07:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-30 07:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-30 07:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202 to the API
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'hybrid',
 'id': '6839f4b5-8145-5ebb-a1d2-b226fb3f6722',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE11202',
 'listing': 'auction',
 'make': 'MG',
 'model': '3',
 'odometer': 11400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-15',
 'seller_name': None,
 'title': 'MG 3 1.5 Hybrid+ Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2025}
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Saving data for UE11202: {'auction_closing_time': 1774885975.0, 'created_time': 1774552619.917788, 'last_price_update_time': 1774856331.857746}
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE11202') HTTP/1.1" 204 0
2026-03-30 07:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-30 07:38:52 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:53 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 7828 | hits on page: 40
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 07:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:54 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 7828 | hits on page: 40
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [auto1.de] INFO: Scrape type for BR96483: 2
2026-03-30 07:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-30 07:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-30 07:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8, identifier: BR96483
2026-03-30 07:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-30 07:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-30 07:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483 to the API
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:44:36Z',
 'fuel_type': 'diesel',
 'id': 'e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR96483',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 266856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-18',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Saving data for BR96483: {'auction_closing_time': 1774885476.0, 'created_time': 1774552676.760561, 'last_price_update_time': 1774856335.262752}
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR96483') HTTP/1.1" 204 0
2026-03-30 07:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 07:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:56 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 7830 | hits on page: 40
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-30 07:38:56 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [auto1.de] INFO: Scrape type for UA00536: 2
2026-03-30 07:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-30 07:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-30 07:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61f77df8-94bc-50ac-a637-eff6158e3057, identifier: UA00536
2026-03-30 07:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-30 07:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-30 07:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536 to the API
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:43:42Z',
 'fuel_type': 'petrol',
 'id': '61f77df8-94bc-50ac-a637-eff6158e3057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA00536',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 120819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Saving data for UA00536: {'auction_closing_time': 1774885422.0, 'created_time': 1774552439.39108, 'last_price_update_time': 1774856337.141159}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA00536') HTTP/1.1" 204 0
2026-03-30 07:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 07:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:58 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 7832 | hits on page: 40
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-30 07:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:00 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 7832 | hits on page: 40
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for TP00598: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 07:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:02 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 7837 | hits on page: 40
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for KU16473: 2
2026-03-30 07:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-30 07:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-30 07:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a, identifier: KU16473
2026-03-30 07:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-30 07:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-30 07:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473 to the API
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:13:15Z',
 'fuel_type': 'petrol',
 'id': '493b1b3d-62e6-5c80-a9df-1c1a45fd667a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU16473',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 227149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2005}
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Saving data for KU16473: {'auction_closing_time': 1774883595.0, 'created_time': 1774552710.887056, 'last_price_update_time': 1774856342.911167}
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU16473') HTTP/1.1" 204 0
2026-03-30 07:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:04 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 7839 | hits on page: 40
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for VS72441: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-30 07:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:05 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 7842 | hits on page: 40
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for CK27476: 2
2026-03-30 07:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-30 07:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-30 07:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-30 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 330338cb-3703-531e-bfe6-681a9cf1fdff, identifier: CK27476
2026-03-30 07:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-30 07:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-30 07:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476 to the API
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:37:39Z',
 'fuel_type': 'diesel',
 'id': '330338cb-3703-531e-bfe6-681a9cf1fdff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK27476',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 140795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Saving data for CK27476: {'auction_closing_time': 1774885059.0, 'created_time': 1774552967.285749, 'last_price_update_time': 1774856346.384197}
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK27476') HTTP/1.1" 204 0
2026-03-30 07:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-30 07:39:06 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-30 07:39:06 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 27 pages/min), scraped 469 items (at 33 items/min)
2026-03-30 07:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:07 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 7844 | hits on page: 40
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for MT90802: 2
2026-03-30 07:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-30 07:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-30 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-30 07:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e54dd4-b604-5ebe-ba17-f51f182b21dc, identifier: MT90802
2026-03-30 07:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-30 07:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-30 07:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802 to the API
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:56:32Z',
 'fuel_type': 'petrol',
 'id': '83e54dd4-b604-5ebe-ba17-f51f182b21dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT90802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 259410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2012}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Saving data for MT90802: {'auction_closing_time': 1774886192.0, 'created_time': 1774552730.077489, 'last_price_update_time': 1774856348.073712}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT90802') HTTP/1.1" 204 0
2026-03-30 07:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for CE31107: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-30 07:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:09 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 7844 | hits on page: 40
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for RG74932: 2
2026-03-30 07:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-30 07:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-30 07:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3be55d76-3f10-5cd1-93f4-0831693ac6b0, identifier: RG74932
2026-03-30 07:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-30 07:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-30 07:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932 to the API
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:33:56Z',
 'fuel_type': 'petrol',
 'id': '3be55d76-3f10-5cd1-93f4-0831693ac6b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG74932',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 232113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Saving data for RG74932: {'auction_closing_time': 1774884836.0, 'created_time': 1774551877.545696, 'last_price_update_time': 1774856349.951813}
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG74932') HTTP/1.1" 204 0
2026-03-30 07:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 07:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:14 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 7856 | hits on page: 40
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for EE67524: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-30 07:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:16 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 7856 | hits on page: 40
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 07:39:16 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 07:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:18 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 7860 | hits on page: 40
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-30 07:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:19 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 7862 | hits on page: 40
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for CB52035: 2
2026-03-30 07:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-30 07:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-30 07:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-30 07:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c545d778-8fe6-53f9-b700-b5146a776dc7, identifier: CB52035
2026-03-30 07:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-30 07:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-30 07:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035 to the API
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:31Z',
 'fuel_type': 'petrol',
 'id': 'c545d778-8fe6-53f9-b700-b5146a776dc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB52035',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 123112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Exclusive-Line',
 'transmission': 'manual',
 'trim': 'Exclusive-Line',
 'year': 2015}
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Saving data for CB52035: {'auction_closing_time': 1774884751.0, 'created_time': 1774552718.204607, 'last_price_update_time': 1774856360.36376}
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB52035') HTTP/1.1" 204 0
2026-03-30 07:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-30 07:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:21 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 7866 | hits on page: 40
2026-03-30 07:39:21 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-30 07:39:21 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-30 07:39:21 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 07:39:21 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-30 07:39:21 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-30 07:39:21 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for DG24182: 2
2026-03-30 07:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-30 07:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 391363dd-df68-5ec1-8671-1bfa10354a9b, identifier: DG24182
2026-03-30 07:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-30 07:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-30 07:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182 to the API
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:31:43Z',
 'fuel_type': 'petrol',
 'id': '391363dd-df68-5ec1-8671-1bfa10354a9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG24182',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 55281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2021}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Saving data for DG24182: {'auction_closing_time': 1774884703.0, 'created_time': 1774553000.517741, 'last_price_update_time': 1774856362.466609}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG24182') HTTP/1.1" 204 0
2026-03-30 07:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 07:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:23 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 7870 | hits on page: 40
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-30 07:39:23 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-30 07:39:23 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-30 07:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:25 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 7870 | hits on page: 40
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for JX01740: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-30 07:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:27 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 7871 | hits on page: 40
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for HV21869: 2
2026-03-30 07:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-30 07:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-30 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-30 07:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f212d7-cafe-5533-a353-89c6013d5fb6, identifier: HV21869
2026-03-30 07:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-30 07:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-30 07:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869 to the API
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:21Z',
 'fuel_type': 'petrol',
 'id': 'f2f212d7-cafe-5533-a353-89c6013d5fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV21869',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 91979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-31',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Saving data for HV21869: {'auction_closing_time': 1774883841.0, 'created_time': 1774552721.987186, 'last_price_update_time': 1774856368.376058}
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV21869') HTTP/1.1" 204 0
2026-03-30 07:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-30 07:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:29 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 7874 | hits on page: 40
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-30 07:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:31 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 7875 | hits on page: 40
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for NP64585: 2
2026-03-30 07:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-30 07:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-30 07:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b5b8f-6920-59cf-91f0-bb473f4d9d82, identifier: NP64585
2026-03-30 07:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-30 07:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-30 07:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585 to the API
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:10Z',
 'fuel_type': 'diesel',
 'id': '321b5b8f-6920-59cf-91f0-bb473f4d9d82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP64585',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 115054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
 'transmission': 'manual',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Saving data for NP64585: {'auction_closing_time': 1774885990.0, 'created_time': 1774550722.680514, 'last_price_update_time': 1774856371.962866}
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP64585') HTTP/1.1" 204 0
2026-03-30 07:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:33 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 7878 | hits on page: 40
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-30 07:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:34 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 7879 | hits on page: 40
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-30 07:39:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:36 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 7880 | hits on page: 40
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for UP35116: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 07:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:37 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 7883 | hits on page: 40
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-30 07:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:39 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 7884 | hits on page: 40
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-30 07:39:39 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-30 07:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:40 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 7885 | hits on page: 40
2026-03-30 07:39:40 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-30 07:39:40 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-30 07:39:40 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 07:39:41 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-30 07:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:42 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 7888 | hits on page: 40
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for SP71400: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-30 07:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:44 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 7891 | hits on page: 40
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-30 07:39:44 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for MV27472: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-30 07:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:46 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 7896 | hits on page: 40
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-30 07:39:46 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 07:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:48 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 7900 | hits on page: 40
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-30 07:39:48 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-30 07:39:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:49 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 7900 | hits on page: 40
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 07:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:51 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 7905 | hits on page: 40
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for VX05177: 2
2026-03-30 07:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-30 07:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b3d7712-a374-5d9e-8caf-726c5516141c, identifier: VX05177
2026-03-30 07:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-30 07:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-30 07:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177 to the API
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:40Z',
 'fuel_type': 'petrol',
 'id': '3b3d7712-a374-5d9e-8caf-726c5516141c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX05177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 27849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Saving data for VX05177: {'auction_closing_time': 1774886380.0, 'created_time': 1773946027.48638, 'last_price_update_time': 1774856392.068603}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX05177') HTTP/1.1" 204 0
2026-03-30 07:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: US61717
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-30 07:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:53 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 7905 | hits on page: 40
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-30 07:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:54 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 7906 | hits on page: 40
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for GD44773: 2
2026-03-30 07:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-30 07:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-30 07:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76b4810-de70-517a-a5a9-5bf0cda02c8d, identifier: GD44773
2026-03-30 07:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-30 07:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-30 07:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773 to the API
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:27:35Z',
 'fuel_type': 'petrol',
 'id': 'a76b4810-de70-517a-a5a9-5bf0cda02c8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44773',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 180414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Saving data for GD44773: {'auction_closing_time': 1774884455.0, 'created_time': 1773227004.528933, 'last_price_update_time': 1774856395.903659}
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD44773') HTTP/1.1" 204 0
2026-03-30 07:39:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:58 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 7912 | hits on page: 40
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-30 07:39:59 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-30 07:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:00 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 7914 | hits on page: 40
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for GE87881: 2
2026-03-30 07:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-30 07:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-30 07:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-30 07:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d829f77c-2554-5c6d-a935-664f70684e7d, identifier: GE87881
2026-03-30 07:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-30 07:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-30 07:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881 to the API
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'diesel',
 'id': 'd829f77c-2554-5c6d-a935-664f70684e7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE87881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 96990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-21',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Saving data for GE87881: {'auction_closing_time': 1774884817.0, 'created_time': 1774552899.19547, 'last_price_update_time': 1774856401.492126}
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE87881') HTTP/1.1" 204 0
2026-03-30 07:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-30 07:40:01 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 07:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:02 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 7918 | hits on page: 40
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: US56502
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-30 07:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:03 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 7920 | hits on page: 40
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: US92808
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 07:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:05 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 7921 | hits on page: 40
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-30 07:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:06 [scrapy.extensions.logstats] INFO: Crawled 343 pages (at 31 pages/min), scraped 478 items (at 9 items/min)
2026-03-30 07:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:36 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 7969 | hits on page: 40
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 07:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:38 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 7971 | hits on page: 40
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-30 07:40:38 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-30 07:40:38 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 07:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:39 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 7974 | hits on page: 40
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 07:40:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:41 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 7976 | hits on page: 40
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-30 07:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:49 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 7982 | hits on page: 40
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-30 07:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:51 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 7988 | hits on page: 40
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for DE59201: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-30 07:40:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:52 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 7992 | hits on page: 40
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-30 07:40:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:53 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 7992 | hits on page: 40
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for KF40481: 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 07:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:55 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 7994 | hits on page: 40
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for XP52765: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 07:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:56 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 7999 | hits on page: 40
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for EX67189: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-30 07:40:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:57 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 8001 | hits on page: 40
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-30 07:40:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:59 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 8001 | hits on page: 40
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for XD68871: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-30 07:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:01 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 8001 | hits on page: 40
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 07:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:02 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 8005 | hits on page: 40
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-30 07:41:02 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-30 07:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:04 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 8005 | hits on page: 40
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 07:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:05 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 8006 | hits on page: 40
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 07:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:06 [scrapy.extensions.logstats] INFO: Crawled 359 pages (at 16 pages/min), scraped 478 items (at 0 items/min)
2026-03-30 07:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:07 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 8006 | hits on page: 40
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 07:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:08 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 8010 | hits on page: 40
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 07:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:10 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 8012 | hits on page: 40
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 07:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:11 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 8014 | hits on page: 40
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-30 07:41:11 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for HD35365: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-30 07:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:17 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 8020 | hits on page: 40
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-30 07:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:26 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 8038 | hits on page: 40
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 07:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:28 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 8041 | hits on page: 40
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-30 07:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:29 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 8042 | hits on page: 40
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for NF65308: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for RB21288: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for TL00985: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for SM64754: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for PL66942: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for RU39212: 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for ZS99681: 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for EE75447: 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for SP96955: 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for GS31332: 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 07:41:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:34 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 8044 | hits on page: 40
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for TH39634: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for ZS85048: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for ZY92659: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for DK37949: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for RF12873: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for XR35811: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for NC71734: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for JN07474: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for XZ21442: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for YE73742: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for CA87699: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for XU33519: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for NK26673: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for NM76791: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for UN89180: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for YH18669: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for KD63113: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for FL46038: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for NX82618: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for ZD28041: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for LK56613: 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 07:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:36 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 8046 | hits on page: 40
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for HX78633: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for GY83312: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for BG42804: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for HG43188: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for CW85183: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for KV68719: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for GJ18953: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for GR83992: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for BV89454: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for MX21840: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for DR45963: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for RW68722: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for JX30830: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for EC85375: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for VX97978: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for ED69500: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for AN99140: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for FD40697: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-30 07:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:37 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 8049 | hits on page: 40
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for UG29438: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for KA54911: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for TV53465: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for UP69379: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for TP61394: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for BU21003: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for CG91765: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for NG66001: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for EA38947: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for HZ69536: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for TK93923: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for CS73315: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 07:41:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:38 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 8053 | hits on page: 40
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for LW95470: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for TV85934: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for YN15081: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for PR24120: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for WB47522: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for JL46304: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for LL96634: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for HV52023: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for YT21216: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for EH91304: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for RR27166: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for SJ72548: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for SY42721: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for RM21545: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for UC78524: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for WG52031: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for RY75144: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for BX11542: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for DN27813: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for HZ35402: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-30 07:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:40 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 8057 | hits on page: 40
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for WK48382: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for AN23805: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for VL97674: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for UT78656: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for RT81127: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for KK21790: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 07:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:52 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 8077 | hits on page: 40
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for CY46145: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for NC58057: 0
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-30 07:41:52 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-30 07:41:52 [auto1.de] INFO: Scrape type for TF03370: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for UL28707: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for FR17679: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for XG50299: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for VR85555: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for VB32886: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 07:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:54 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 8084 | hits on page: 40
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for CE21106: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for BN42758: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for ZH67756: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for PN96283: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for KZ38664: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for MF03624: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for EK32140: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for BH61935: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for CV13370: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for GF54025: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for KK05104: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-30 07:41:54 [auto1.de] INFO: Scrape type for DT00553: 0
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-30 07:41:54 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-30 07:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for GM93554: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for KC33777: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for JD18961: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for EU91257: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-30 07:41:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:56 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 8084 | hits on page: 40
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZM06899: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZD05213: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-30 07:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:57 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 8087 | hits on page: 40
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for SS01468: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for VU61436: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for YD79813: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for JR23306: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for YN71631: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for EM86154: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for SK06184: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for SZ07968: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for RT44513: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for JB74543: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for HX73394: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for ES38254: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for PU69799: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for BM68891: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for AN35443: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for CP64572: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for CA31284: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for JE64211: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-30 07:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:59 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 8088 | hits on page: 40
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for UM98970: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for PP81333: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for RS29828: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for WB65429: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for BV82977: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for ZV11386: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for FW24707: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for NE29415: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for LF31183: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for RU06209: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for CN30644: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for PC42361: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for ZD03679: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for AJ68338: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for XY91311: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for UJ32060: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for VX51529: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for ZX35580: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for MB10012: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for JB16135: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for WX88880: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for AL99999: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for LD20816: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 07:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:00 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 8090 | hits on page: 40
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for PB68045: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for FK87134: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for AC64408: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for MS92853: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for KJ96076: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for US66744: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for GB90564: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for RL85498: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for NV50024: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for WB83413: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for NX27502: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for MF21991: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for XR92513: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for GZ82101: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for FT59815: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for TN55271: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for ZA78506: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-30 07:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:02 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 8092 | hits on page: 40
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for YD01023: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for GJ73585: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for YC95910: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for HE47734: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for JR52179: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for LD23223: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for LM31898: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for HL01555: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for WJ67055: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for EJ09183: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for GZ17275: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for GY04691: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for WD20973: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for RN07993: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for EC99072: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-30 07:42:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:06 [scrapy.extensions.logstats] INFO: Crawled 379 pages (at 20 pages/min), scraped 478 items (at 0 items/min)
2026-03-30 07:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 196MiB
2026-03-30 07:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:12 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 8107 | hits on page: 40
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for XX47236: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for AY24824: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for JR48888: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for WX17645: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for FP27721: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for KC60426: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for EL78604: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for KP52427: 0
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-30 07:42:12 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-30 07:42:12 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-30 07:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:13 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 8108 | hits on page: 40
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for YP26052: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for UX04638: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for XT42092: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for ER27214: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for DU68074: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for ZN38550: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for TR40985: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for BW25069: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-30 07:42:13 [auto1.de] INFO: Scrape type for UP55636: 0
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-30 07:42:13 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for ZT83144: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for UY91981: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for VR01975: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for HL66974: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for CJ73141: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for LT88740: 0
2026-03-30 07:42:14 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-30 07:42:14 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-30 07:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:15 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 8109 | hits on page: 40
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-30 07:42:15 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-30 07:42:15 [auto1.de] INFO: Scrape type for ST78057: 0
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-30 07:42:15 [auto1.de] INFO: Scrape type for PV80087: 0
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-30 07:42:15 [auto1.de] INFO: Scrape type for KY32435: 0
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-30 07:42:15 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-30 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for PY07739: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for DN86096: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for RV77607: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for UP26126: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for TV59519: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for AC34212: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for EW67018: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for AL30364: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for FW19107: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for SJ02125: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for VL24807: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-30 07:42:16 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-30 07:42:16 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 07:42:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:17 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 8111 | hits on page: 40
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for ZA82087: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for PR51827: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for KU26816: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for CM42106: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for UR14680: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for GZ33681: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for XT67395: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for XT85364: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for KJ39198: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for EX55373: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for BN44220: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 07:42:17 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-30 07:42:17 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-30 07:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:18 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 8117 | hits on page: 40
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for HM10485: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for GZ74020: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for HZ02763: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for KZ16493: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for DF05561: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for GK39429: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for MV07839: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for AW19440: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for DG41556: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for HU15676: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for ZM61762: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for LJ25581: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for LL75700: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for NG57043: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for XA48872: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for ZZ30319: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for FJ78997: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for SC04632: 0
2026-03-30 07:42:18 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-30 07:42:18 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-30 07:42:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:20 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 8118 | hits on page: 40
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for GL40281: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for WC65602: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for HF13996: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for RX58241: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for VN03026: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for NS77188: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for GT32005: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for SF89930: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for FF09080: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for JR73784: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for DT59270: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for AY51976: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-30 07:42:20 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-30 07:42:20 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-30 07:42:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:24 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 8123 | hits on page: 40
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for VZ43833: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for HA56884: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for FD80393: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for DA22909: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for BF10429: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-30 07:42:24 [auto1.de] INFO: Scrape type for XY13632: 0
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 07:42:24 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for TS47391: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for JD30879: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for ZF87196: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for DK10749: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for DD00982: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for JV93942: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for RR37288: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-30 07:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:26 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 8123 | hits on page: 40
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for XL20163: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for RW03523: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for ZY17523: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for GW53776: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for PH41345: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for FB79072: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for KW07987: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for HC06893: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for BM85402: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for CA67550: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for PJ27517: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 07:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:27 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 8123 | hits on page: 40
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for RR83304: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for UE39516: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for GM93366: 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for VV13794: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for FH72870: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for GR32471: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for RV36249: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for TJ69669: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for CX33153: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for XL82798: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for DE88009: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for HF51839: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-30 07:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:30 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 8125 | hits on page: 40
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for KE20907: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for ZM57049: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for KW41122: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for EU16330: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for DR88922: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for SL55745: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for WA61115: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for SJ49235: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for BT33018: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for KT95165: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for JX65004: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for VG77732: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for MW16405: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-30 07:42:30 [auto1.de] INFO: Scrape type for BY24352: 0
2026-03-30 07:42:30 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for CN43056: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for SV90594: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for RA08562: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for EL77757: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for MZ03639: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for BS45971: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for NT95392: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 07:42:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:32 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 8130 | hits on page: 40
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for FB20065: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for YV73995: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for JX55294: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for BK93979: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for LC65511: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-30 07:42:32 [auto1.de] INFO: Scrape type for NH74164: 0
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-30 07:42:32 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-30 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for CG50140: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for YL16347: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for MN41763: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for SY55071: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for WT57840: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for BZ34179: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for GZ42240: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for DZ63249: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for MN76950: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for KV46000: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for TA12646: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-30 07:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:34 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 8131 | hits on page: 40
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for VG58612: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for YC71395: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for SW39146: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for SS56268: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for HM38388: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for SA98041: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for HS55924: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for RM27503: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for NU23342: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for FL62048: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for MG84960: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for KU56806: 0
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 07:42:34 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-30 07:42:34 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-30 07:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:35 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 8132 | hits on page: 40
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for ME28341: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for AU10222: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for MN75028: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for SB90605: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for HL93382: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for HU71027: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for HW93754: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for NB68023: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for BG93361: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for FT64289: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for KE10146: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for PN64243: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for WH57282: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for SE82228: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for ZY49257: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for PG18082: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for VX47645: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 07:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:37 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 8135 | hits on page: 40
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for HE38410: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for YC00182: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for KZ11771: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for HJ16589: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for KM53361: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for PU74458: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for NK23311: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-30 07:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:38 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 8141 | hits on page: 40
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for SM71650: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for ZU52934: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for PW89679: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for GD61279: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for KU32415: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for NG84191: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for UX99567: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for SR86923: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for CZ39134: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for EU15499: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for HG48100: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for WA68058: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for RZ05971: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for VL73605: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for TZ58013: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-30 07:42:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:41 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 8145 | hits on page: 40
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for GR42785: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for MM73538: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for AH24505: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for RF00811: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for CA70430: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for AZ56926: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for GY33643: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for EK48004: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for WJ88731: 2
2026-03-30 07:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-30 07:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-30 07:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-30 07:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e7d92d-40dc-520a-bd63-40bdfa513f52, identifier: WJ88731
2026-03-30 07:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-30 07:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-30 07:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731 to the API
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:02Z',
 'fuel_type': 'diesel',
 'id': '57e7d92d-40dc-520a-bd63-40bdfa513f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ88731',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 224746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Saving data for WJ88731: {'auction_closing_time': 1774884722.0, 'created_time': 1774349360.183378, 'last_price_update_time': 1774856562.144045}
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ88731') HTTP/1.1" 204 0
2026-03-30 07:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for WA60872: 2
2026-03-30 07:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-30 07:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-30 07:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-30 07:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a7e9528-bd23-5cf0-84bc-d15e226d5405, identifier: WA60872
2026-03-30 07:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-30 07:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-30 07:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872 to the API
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:10Z',
 'fuel_type': 'petrol',
 'id': '1a7e9528-bd23-5cf0-84bc-d15e226d5405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA60872',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 112988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-08',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Saving data for WA60872: {'auction_closing_time': 1774885090.0, 'created_time': 1773467701.248596, 'last_price_update_time': 1774856562.765745}
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA60872') HTTP/1.1" 204 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for RJ17594: 2
2026-03-30 07:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-30 07:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-30 07:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-30 07:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e839da47-a265-5073-a3c9-e1f3fcc66791, identifier: RJ17594
2026-03-30 07:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-30 07:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-30 07:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594 to the API
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'petrol',
 'id': 'e839da47-a265-5073-a3c9-e1f3fcc66791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ17594',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 134468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-21',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-30 07:42:43 [auto1.de] INFO: Saving data for RJ17594: {'auction_closing_time': 1774885275.0, 'created_time': 1774032970.814148, 'last_price_update_time': 1774856563.227891}
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ17594') HTTP/1.1" 204 0
2026-03-30 07:42:43 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-30 07:42:43 [auto1.de] INFO: Scrape type for WC98530: 2
2026-03-30 07:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-30 07:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-30 07:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-30 07:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c67fdd3d-1904-5dd2-9b74-02e70968d0cd, identifier: WC98530
2026-03-30 07:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-30 07:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-30 07:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530 to the API
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'petrol',
 'id': 'c67fdd3d-1904-5dd2-9b74-02e70968d0cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98530',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 158677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2016}
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-30 07:42:43 [auto1.de] INFO: Saving data for WC98530: {'auction_closing_time': 1774884856.0, 'created_time': 1773467740.019583, 'last_price_update_time': 1774856563.636683}
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC98530') HTTP/1.1" 204 0
2026-03-30 07:42:43 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-30 07:42:43 [auto1.de] INFO: Scrape type for ET93890: 2
2026-03-30 07:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-30 07:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-30 07:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-30 07:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65f4b38-f73c-522e-b3fd-0c404dc63004, identifier: ET93890
2026-03-30 07:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-30 07:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-30 07:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890 to the API
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'petrol',
 'id': 'b65f4b38-f73c-522e-b3fd-0c404dc63004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET93890',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 113804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Saving data for ET93890: {'auction_closing_time': 1774885682.0, 'created_time': 1774118797.859971, 'last_price_update_time': 1774856564.031176}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET93890') HTTP/1.1" 204 0
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Scrape type for DV01854: 2
2026-03-30 07:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-30 07:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4, identifier: DV01854
2026-03-30 07:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-30 07:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-30 07:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854 to the API
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:47:44Z',
 'fuel_type': 'petrol',
 'id': '354d9018-5234-551b-b3e4-d3a6ed7c5ad4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV01854',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 98909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2017}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Saving data for DV01854: {'auction_closing_time': 1774885664.0, 'created_time': 1774031526.51608, 'last_price_update_time': 1774856564.438977}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV01854') HTTP/1.1" 204 0
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Scrape type for UE23148: 2
2026-03-30 07:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-30 07:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94f7b76f-04a9-586f-8ca0-47c78321bc64, identifier: UE23148
2026-03-30 07:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-30 07:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-30 07:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148 to the API
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': '94f7b76f-04a9-586f-8ca0-47c78321bc64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE23148',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 147585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-06',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Reference Viva',
 'transmission': 'manual',
 'trim': 'Reference Viva',
 'year': 2012}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Saving data for UE23148: {'auction_closing_time': 1774884844.0, 'created_time': 1773340610.380669, 'last_price_update_time': 1774856564.853334}
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE23148') HTTP/1.1" 204 0
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-30 07:42:44 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-30 07:42:44 [auto1.de] INFO: Scrape type for ZS91776: 2
2026-03-30 07:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-30 07:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-30 07:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 899911fb-c83e-509a-9d54-68363a7de170, identifier: ZS91776
2026-03-30 07:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-30 07:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-30 07:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776 to the API
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:37:00Z',
 'fuel_type': 'petrol',
 'id': '899911fb-c83e-509a-9d54-68363a7de170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS91776',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 94546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.6 Turbo OPC',
 'transmission': 'manual',
 'trim': 'OPC',
 'year': 2010}
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-30 07:42:45 [auto1.de] INFO: Saving data for ZS91776: {'auction_closing_time': 1774885020.0, 'created_time': 1773467171.650569, 'last_price_update_time': 1774856565.269267}
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS91776') HTTP/1.1" 204 0
2026-03-30 07:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-30 07:42:45 [auto1.de] INFO: Scrape type for VX64192: 2
2026-03-30 07:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-30 07:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-30 07:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-30 07:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5805ee99-583c-596a-a675-190db41ed1b1, identifier: VX64192
2026-03-30 07:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-30 07:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-30 07:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192 to the API
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:57Z',
 'fuel_type': 'diesel',
 'id': '5805ee99-583c-596a-a675-190db41ed1b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX64192',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 153076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-09',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-30 07:42:45 [auto1.de] INFO: Saving data for VX64192: {'auction_closing_time': 1774883997.0, 'created_time': 1774118886.855884, 'last_price_update_time': 1774856565.805104}
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX64192') HTTP/1.1" 204 0
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 07:42:45 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-30 07:42:45 [auto1.de] INFO: Scrape type for FX10664: 2
2026-03-30 07:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-30 07:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-30 07:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-30 07:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1, identifier: FX10664
2026-03-30 07:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-30 07:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-30 07:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664 to the API
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:11:26Z',
 'fuel_type': 'diesel',
 'id': '8b6aace6-73a2-5f25-abf9-7cd08a6826b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX10664',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 173452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro Sport selection',
 'transmission': 'automatic',
 'trim': 'quattro Sport selection',
 'year': 2013}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Saving data for FX10664: {'auction_closing_time': 1774883486.0, 'created_time': 1774118554.546192, 'last_price_update_time': 1774856566.308216}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX10664') HTTP/1.1" 204 0
2026-03-30 07:42:46 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 8151 | hits on page: 31
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for ED17592: 2
2026-03-30 07:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-30 07:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-30 07:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-30 07:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac4f785e-414a-5783-bbc9-b6e608012840, identifier: ED17592
2026-03-30 07:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-30 07:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-30 07:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592 to the API
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:57:51Z',
 'fuel_type': 'petrol',
 'id': 'ac4f785e-414a-5783-bbc9-b6e608012840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED17592',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla Verso',
 'odometer': 90377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-27',
 'seller_name': None,
 'title': 'Toyota Corolla Verso 1.8 Sol',
 'transmission': 'automatic',
 'trim': 'Sol',
 'year': 2003}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Saving data for ED17592: {'auction_closing_time': 1774886271.0, 'created_time': 1773467238.933615, 'last_price_update_time': 1774856566.854798}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED17592') HTTP/1.1" 204 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for YS85041: 2
2026-03-30 07:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-30 07:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc741722-e624-5e40-a631-61295802977a, identifier: YS85041
2026-03-30 07:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-30 07:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-30 07:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041 to the API
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:47Z',
 'fuel_type': 'petrol',
 'id': 'cc741722-e624-5e40-a631-61295802977a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS85041',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 151746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2011}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Saving data for YS85041: {'auction_closing_time': 1774883627.0, 'created_time': 1773946040.302004, 'last_price_update_time': 1774856567.490965}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS85041') HTTP/1.1" 204 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for WG54603: 2
2026-03-30 07:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-30 07:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd, identifier: WG54603
2026-03-30 07:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-30 07:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-30 07:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603 to the API
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:45:45Z',
 'fuel_type': 'petrol',
 'id': 'd7dd9e17-be31-5b6b-a31a-e85064d8f3dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG54603',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 168513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Saving data for WG54603: {'auction_closing_time': 1774885545.0, 'created_time': 1773945281.786207, 'last_price_update_time': 1774856567.914723}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG54603') HTTP/1.1" 204 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for VV82390: 2
2026-03-30 07:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-30 07:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-30 07:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7be466fb-b23f-5722-b01b-1945c2a5ab78, identifier: VV82390
2026-03-30 07:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-30 07:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-30 07:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390 to the API
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'diesel',
 'id': '7be466fb-b23f-5722-b01b-1945c2a5ab78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV82390',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 152220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seller_name': None,
 'title': 'Audi A4 45 TDI quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2020}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Saving data for VV82390: {'auction_closing_time': 1774884359.0, 'created_time': 1774349641.18222, 'last_price_update_time': 1774856568.363528}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV82390') HTTP/1.1" 204 0
2026-03-30 07:42:48 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-30 07:42:48 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Scrape type for GY99851: 2
2026-03-30 07:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-30 07:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-30 07:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-30 07:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ee98b40-6325-5042-bb22-26170b1a5d83, identifier: GY99851
2026-03-30 07:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-30 07:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-30 07:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851 to the API
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:57:33Z',
 'fuel_type': 'diesel',
 'id': '5ee98b40-6325-5042-bb22-26170b1a5d83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY99851',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 140000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Saving data for GY99851: {'auction_closing_time': 1774886253.0, 'created_time': 1774293714.839555, 'last_price_update_time': 1774856568.792315}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY99851') HTTP/1.1" 204 0
2026-03-30 07:42:48 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Scrape type for KG73349: 2
2026-03-30 07:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-30 07:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-30 07:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-30 07:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52, identifier: KG73349
2026-03-30 07:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-30 07:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-30 07:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349 to the API
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': '3f95168f-3d5d-5947-b30a-0c1e9baf6d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG73349',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 135637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Saving data for KG73349: {'auction_closing_time': 1774883431.0, 'created_time': 1773467475.85263, 'last_price_update_time': 1774856569.21815}
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG73349') HTTP/1.1" 204 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for ZZ82496: 2
2026-03-30 07:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-30 07:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bcc120-49d0-5a50-84a7-daa7d1a94547, identifier: ZZ82496
2026-03-30 07:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-30 07:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-30 07:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496 to the API
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 585,
 'expiration_date': '2026-03-30T15:09:33Z',
 'fuel_type': 'petrol',
 'id': 'b8bcc120-49d0-5a50-84a7-daa7d1a94547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ82496',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 139095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 63 AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2016}
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Saving data for ZZ82496: {'auction_closing_time': 1774883373.0, 'created_time': 1774034465.270593, 'last_price_update_time': 1774856569.636214}
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ82496') HTTP/1.1" 204 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for MA81744: 2
2026-03-30 07:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-30 07:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c, identifier: MA81744
2026-03-30 07:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-30 07:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-30 07:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744 to the API
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:13:26Z',
 'fuel_type': 'hybrid',
 'id': '9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81744',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 177312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Audi A6 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2021}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Saving data for MA81744: {'auction_closing_time': 1774883606.0, 'created_time': 1773775383.337339, 'last_price_update_time': 1774856570.161371}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81744') HTTP/1.1" 204 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for KG50767: 2
2026-03-30 07:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-30 07:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-30 07:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-30 07:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fba9dcc1-4ef9-5a74-bb65-bee726d73a84, identifier: KG50767
2026-03-30 07:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-30 07:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-30 07:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767 to the API
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:02:15Z',
 'fuel_type': 'diesel',
 'id': 'fba9dcc1-4ef9-5a74-bb65-bee726d73a84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG50767',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 167652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Saving data for KG50767: {'auction_closing_time': 1774882935.0, 'created_time': 1773468255.451886, 'last_price_update_time': 1774856570.57617}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG50767') HTTP/1.1" 204 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for AR70360: 2
2026-03-30 07:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-30 07:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-30 07:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-30 07:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5, identifier: AR70360
2026-03-30 07:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-30 07:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-30 07:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360 to the API
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'diesel',
 'id': '2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR70360',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 180598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-07',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Saving data for AR70360: {'auction_closing_time': 1774884243.0, 'created_time': 1774350011.939473, 'last_price_update_time': 1774856571.000526}
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR70360') HTTP/1.1" 204 0
2026-03-30 07:42:51 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-30 07:42:51 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Scrape type for XL74124: 2
2026-03-30 07:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-30 07:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-30 07:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-30 07:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 404c4fca-c19b-5890-84ee-eb3638987a80, identifier: XL74124
2026-03-30 07:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-30 07:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-30 07:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124 to the API
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'petrol',
 'id': '404c4fca-c19b-5890-84ee-eb3638987a80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL74124',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 49591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2021}
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Saving data for XL74124: {'auction_closing_time': 1774882876.0, 'created_time': 1773468768.767412, 'last_price_update_time': 1774856571.42292}
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL74124') HTTP/1.1" 204 0
2026-03-30 07:42:51 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Scrape type for WX78972: 2
2026-03-30 07:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-30 07:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-30 07:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-30 07:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b960b74-6842-5897-b927-5fc7a7079f3c, identifier: WX78972
2026-03-30 07:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-30 07:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-30 07:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972 to the API
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:23:58Z',
 'fuel_type': 'diesel',
 'id': '9b960b74-6842-5897-b927-5fc7a7079f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX78972',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 127572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-23',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Saving data for WX78972: {'auction_closing_time': 1774884238.0, 'created_time': 1774089113.821685, 'last_price_update_time': 1774856571.892504}
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX78972') HTTP/1.1" 204 0
2026-03-30 07:42:51 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-30 07:42:51 [auto1.de] INFO: Scrape type for TW02363: 2
2026-03-30 07:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-30 07:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-30 07:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0e6415-259d-5316-bfdc-885b264b1bb2, identifier: TW02363
2026-03-30 07:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-30 07:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-30 07:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363 to the API
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'diesel',
 'id': '6b0e6415-259d-5316-bfdc-885b264b1bb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW02363',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 180552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-30 07:42:52 [auto1.de] INFO: Saving data for TW02363: {'auction_closing_time': 1774884360.0, 'created_time': 1773945603.287468, 'last_price_update_time': 1774856572.332538}
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW02363') HTTP/1.1" 204 0
2026-03-30 07:42:52 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 8162 | hits on page: 2
2026-03-30 07:42:52 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-30 07:42:52 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-30 07:42:52 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-30 07:42:52 [auto1.de] INFO: Scrape type for YV43994: 2
2026-03-30 07:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-30 07:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f, identifier: YV43994
2026-03-30 07:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-30 07:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-30 07:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994 to the API
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'diesel',
 'id': '6ab434dc-a15f-5a3d-9afd-f0ce2e24630f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV43994',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'BMW 3er 318d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-30 07:42:52 [auto1.de] INFO: Saving data for YV43994: {'auction_closing_time': 1774884404.0, 'created_time': 1773984685.528767, 'last_price_update_time': 1774856572.74717}
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV43994') HTTP/1.1" 204 0
2026-03-30 07:42:52 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 07:42:52 [auto1.de] INFO: Scrape type for HY99539: 2
2026-03-30 07:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-30 07:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb, identifier: HY99539
2026-03-30 07:42:52 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 07:42:52 [auto1.de] INFO: Scrape type for HY99539: 2
2026-03-30 07:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-30 07:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb, identifier: HY99539
2026-03-30 07:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-30 07:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-30 07:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539 to the API
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:15Z',
 'fuel_type': 'petrol',
 'id': 'f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY99539',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 131051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 07:42:53 [auto1.de] INFO: Saving data for HY99539: {'auction_closing_time': 1774884375.0, 'created_time': 1774380352.806279, 'last_price_update_time': 1774856573.267741}
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY99539') HTTP/1.1" 204 0
2026-03-30 07:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-30 07:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-30 07:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539 to the API
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:15Z',
 'fuel_type': 'petrol',
 'id': 'f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY99539',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 131051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 07:42:53 [auto1.de] INFO: Saving data for HY99539: {'auction_closing_time': 1774884375.0, 'created_time': 1774380352.806279, 'last_price_update_time': 1774856573.630285}
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY99539') HTTP/1.1" 204 0
2026-03-30 07:42:53 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 07:42:53 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 07:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:54 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 8169 | hits on page: 0
2026-03-30 07:42:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 07:42:54 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-30 07:42:54 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-30 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774424574 HTTP/1.1" 200 None
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AB56967') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD17983') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE29934') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE83779') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG69292') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH02378') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL45448') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AP70835') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR52532') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS67222') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT05944') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU45079') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU89070') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX74187') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX80742') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AY35242') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA43176') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA61703') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC17196') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD39922') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD94781') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ85670') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ99800') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK01880') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK80140') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS31363') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS58227') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BT40201') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV50851') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV56212') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX10116') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX89288') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY38830') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB39322') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC86665') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP67289') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS32870') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS54953') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU22301') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY33595') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA44712') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB95051') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC42588') HTTP/1.1" 204 0
2026-03-30 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD10328') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK17732') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DP15384') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR87346') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT34822') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU73675') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV69567') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DX77293') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY45662') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY49758') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY74361') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ15282') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB33360') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED20045') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF14118') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM15276') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN41309') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN56528') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER40666') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER82138') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW56131') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ67237') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB47494') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FC90926') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF54310') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ44324') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL29012') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL81508') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP22246') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP58671') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT08851') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV99731') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX40665') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX77731') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB44708') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE74181') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF15006') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GG07859') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN01216') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS77433') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU70051') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW46246') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW95545') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX57657') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA20586') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA37625') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD45499') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE28808') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HH63318') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ57447') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HK16154') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM07899') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HN52392') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS91088') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT91077') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT99983') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU65226') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX14092') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB14555') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC01878') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC78052') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD75047') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE18159') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK71664') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JL46781') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JM64361') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JS02187') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU06063') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW00290') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX13260') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX28103') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20390') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ46484') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC01642') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC19039') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD99455') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE34822') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH88059') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL83940') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS05532') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS36294') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT29064') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT34849') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV50593') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY55968') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY78612') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA60747') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LB09023') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD15689') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LF55320') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG29954') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG30254') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG78408') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LH35319') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM11981') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM48068') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR91304') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS10093') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS76923') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT03056') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MB32760') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MC88440') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD82388') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME34281') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG86543') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK72286') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK86213') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR08206') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR74936') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS69312') HTTP/1.1" 204 0
2026-03-30 07:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT36138') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MV22055') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MY29813') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ57411') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA40709') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA80596') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC73719') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND12077') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG72065') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ33088') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK34033') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK81207') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NL19979') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NN29127') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP98224') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR37462') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR85594') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS22873') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT83391') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NU64922') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX85404') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NY96025') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ38096') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA28506') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA46448') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PB46741') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC55242') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD03791') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD85816') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE34232') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PF77669') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PG43779') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK00641') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM92566') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN39573') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS08228') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS36762') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV50607') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW04497') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW05590') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW06816') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PX64342') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PY80793') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB32384') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB61667') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC90931') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC92859') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC99356') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RK29337') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RM29445') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP65650') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RR13912') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS58437') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT30217') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT97145') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV59565') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX27248') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX60132') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY30273') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY60317') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY73052') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE38462') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE94330') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG21208') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL66423') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR17776') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST69736') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU59543') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW11409') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY38689') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ55897') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TC40512') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TD14280') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TD39066') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH34949') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK80164') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TM66021') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TN74986') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV40584') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TW02657') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX83563') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX83676') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UA03339') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE01246') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE99190') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG25956') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ43061') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM77557') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UN10528') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP23354') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UT50603') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UT62234') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UU20428') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV19102') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW97572') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY96873') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ05324') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VD32518') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE22571') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK46817') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL80795') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN30897') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN68338') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN80088') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR46992') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR56399') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT43145') HTTP/1.1" 204 0
2026-03-30 07:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV52010') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW65051') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ38032') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ60616') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ64850') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA15492') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA56629') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB31314') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB89242') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD71163') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WF27599') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WF29646') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG33270') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH28949') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK43441') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM20334') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM84012') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WN16072') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WN57099') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP07187') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP98104') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR01995') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS97198') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WX91745') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ27485') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA23741') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB70310') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB85321') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD21677') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XG47436') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XG56148') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ36969') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM77078') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XR09297') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV43829') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY24734') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ63736') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA31910') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YC65488') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF04765') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG84560') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH22570') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL20348') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL30575') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YN55561') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR10738') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR20513') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX11866') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX18743') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY35891') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA20741') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB34831') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC55793') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD38426') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD44580') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD46360') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE47311') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE60737') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG65136') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH56707') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK31812') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK56270') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL04476') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL69810') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM88551') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN26343') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP04224') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU24549') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU31470') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV92037') HTTP/1.1" 204 0
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY48885') HTTP/1.1" 204 0
2026-03-30 07:42:59 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (504 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-30T07_30_00.jl
2026-03-30 07:42:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1431345,
 'downloader/request_count': 680,
 'downloader/request_method_count/GET': 472,
 'downloader/request_method_count/POST': 208,
 'downloader/response_bytes': 197911169,
 'downloader/response_count': 680,
 'downloader/response_status_count/200': 680,
 'dupefilter/filtered': 52,
 'elapsed_time_seconds': 773.046954,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 7, 42, 59, 648391, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 504,
 'log_count/DEBUG': 15992,
 'log_count/INFO': 19124,
 'memusage/max': 205529088,
 'memusage/startup': 150163456,
 'photo_download_count': 282,
 'request_depth_max': 209,
 'response_received_count': 398,
 'scheduler/dequeued': 680,
 'scheduler/dequeued/memory': 680,
 'scheduler/enqueued': 680,
 'scheduler/enqueued/memory': 680,
 'scrape_type/batch_skipped': 4112,
 'scrape_type/new': 94,
 'scrape_type/price_update': 410,
 'scrape_type/skipped': 3525,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 398,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.069166457261796,
 'scrapy-zyte-api/mean_response_seconds': 4.145605006372211,
 'scrapy-zyte-api/processed': 398,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 398,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 397,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 398,
 'scrapy-zyte-api/request_args/httpRequestBody': 208,
 'scrapy-zyte-api/request_args/httpRequestMethod': 208,
 'scrapy-zyte-api/request_args/httpResponseBody': 398,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 398,
 'scrapy-zyte-api/request_args/sessionContext': 398,
 'scrapy-zyte-api/request_args/url': 398,
 'scrapy-zyte-api/status_codes/200': 398,
 'scrapy-zyte-api/success': 398,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 8193,
 'source/total_available': 8169,
 'start_time': datetime.datetime(2026, 3, 30, 7, 30, 6, 601437, tzinfo=datetime.timezone.utc)}
2026-03-30 07:42:59 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 07:42:59 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f71be85a050>
2026-03-30 07:42:59 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f71be9a8090>