2025-12-05 07:01:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 88e5494b-af7e-5eb6-9753-c64b799f7024: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8ecbc28c-6287-5034-bc06-3aef05bab628: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 04f136d4-69ee-5979-8eda-f19240210d9e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f33b770c-8e21-5a52-baa1-d6a566b2eb55: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 31e74bb9-9b42-5d4a-bc5b-cb28347c13d2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b5d43b2f-25ce-5211-994c-644c2c269a41: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:41 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 73c1087c-3679-517d-9aca-e2e22933a243: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:40 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5993b719-2a19-5d4f-baef-3d480dab5136: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 860fb433-3a45-5a34-81ae-e9d9ae170992: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5545fd41-d151-53d7-84d8-81f5483bc2f6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2.11.2

127.0.0.1:6023

0e485b0ead5e37b7

2025-12-05 07:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']

2025-12-05 07:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue>

2025-12-05 07:01:10 [scrapy.extensions.logstats] INFO: Crawled 78 pages (at 78 pages/min), scraped 59 items (at 59 items/min)

2025-12-05 07:00:08 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 07:00:08 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 07:00:08 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-12-05 07:00:08 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 07:00:08 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 07:00:08 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 07:00:08 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 07:00:08 [scrapy.extensions.telnet] INFO: Telnet Password: 0e485b0ead5e37b7
2025-12-05 07:00:08 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 07:00:08 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-05T07_00_01.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 07:00:08 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 07:00:08 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 07:00:08 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 07:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 07:00:08 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 07:00:08 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 07:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 07:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 07:00:09 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 07:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 07:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:00:09 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 07:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 07:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 07:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 07:00:09 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 07:00:09 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 07:00:09 [scrapy.core.engine] INFO: Spider opened
2025-12-05 07:00:09 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 07:00:09 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-05 07:00:09 [scrapy-playwright] INFO: Starting download handler

2025-12-05 07:00:09 [scrapy-playwright] INFO: Starting download handler
2025-12-05 07:00:14 [scrapy-playwright] INFO: Launching browser firefox

 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 Zetec S Red 3dr',
 'vin': None,
 'year': 2016}
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-05 07:01:43 [astonbarclay.gb] INFO: Saving data for 117581980: {'auction_closing_time': 1764939600.0, 'created_time': 1764356497.124503, 'last_price_update_time': 1764918103.705107}
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117581980') HTTP/1.1" 204 0
2025-12-05 07:01:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623154, 'registration': 'DC23JSZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2009, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/766243e4-8c07-485a-a42a-fb160e6be3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/91406ba4-04e1-4124-adf3-f5c0671c6a3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/cb6d496e-29f5-4df3-b75b-9d7ecae1524c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/8f8a7f8f-4df1-44e1-9f95-ef3ab2938c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/a0ed0848-f4e3-415c-9473-c77fb1fdcde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/75cfb6c7-f438-4f1f-a019-7b5a4409bbdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/cd80fc75-0d78-44a6-b862-36f997e42993_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/aa2fabb5-bc5e-4a3d-ba01-61498f12a845_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/6064c7e5-0c0a-4db1-8e9d-196501d1d8cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf9096b2-b151-4b02-a167-dc93209358f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-05 07:01:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623154, 'registration': 'DC23JSZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2009, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/766243e4-8c07-485a-a42a-fb160e6be3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/91406ba4-04e1-4124-adf3-f5c0671c6a3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/cb6d496e-29f5-4df3-b75b-9d7ecae1524c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/8f8a7f8f-4df1-44e1-9f95-ef3ab2938c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/a0ed0848-f4e3-415c-9473-c77fb1fdcde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/75cfb6c7-f438-4f1f-a019-7b5a4409bbdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/cd80fc75-0d78-44a6-b862-36f997e42993_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/aa2fabb5-bc5e-4a3d-ba01-61498f12a845_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSZ/2025-12-04/image/6064c7e5-0c0a-4db1-8e9d-196501d1d8cc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf9096b2-b151-4b02-a167-dc93209358f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-05 07:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-05 07:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860fb433-3a45-5a34-81ae-e9d9ae170992 with scrape type 2
2025-12-05 07:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 860fb433-3a45-5a34-81ae-e9d9ae170992 with scrape type 2
2025-12-05 07:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 860fb433-3a45-5a34-81ae-e9d9ae170992, identifier: 117623154
2025-12-05 07:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-05 07:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154
2025-12-05 07:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 860fb433-3a45-5a34-81ae-e9d9ae170992 with identifier: 117623154 to the API
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27860fb433-3a45-5a34-81ae-e9d9ae170992%27 HTTP/1.1" 200 None
2025-12-05 07:01:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 860fb433-3a45-5a34-81ae-e9d9ae170992: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117623154?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '860fb433-3a45-5a34-81ae-e9d9ae170992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JSZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623154',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 17783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-05 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623154%27 HTTP/1.1" 200 None
2025-12-05 07:01:44 [astonbarclay.gb] INFO: Saving data for 117623154: {'auction_closing_time': 1765188000.0, 'created_time': 1764788494.068927, 'last_price_update_time': 1764918104.083612}
2025-12-05 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623154') HTTP/1.1" 204 0
2025-12-05 07:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-05 07:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517475, 'registration': 'WD68SFX', 'account': 'MER023', 'make': 'MINI', 'model': 'CONVERTIBLE', 'derivative': '1.5 Cooper II 2dr', 'mileage': 34783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-05', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/WD68SFX/2025-11-27/image/4588ebdf-63b0-4300-b6a7-4a246ba11c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/d08e1c92-e555-4be8-b617-94fba88ef4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/55302db7-8646-4c10-ad6a-eff9b25f9445_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/c47bb734-c777-498a-bf5c-83417bf684c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/60a9bbb6-62f3-4763-bc2c-e07389c7e5ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/da187a0d-df6d-4b5e-832e-a1e0d9c96256_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/bea286eb-2c2b-4172-bd4a-d857d295f1de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/afd3c6bf-dd10-472a-85cc-401781edfdb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/b105f866-183e-4787-b62d-5f77f855c042_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/25 24K idrive 11/20 7k 10/21 7.8k', 'remarks': 'SKEY - Navigation (including Apple CarPlay), John Cooper Works Sport Pack (includes 17" Track Spoke alloy wheels in black, Performance Control, JCW sport leather steering wheel, JCW rear spoiler, JCW aerodynamic kit, Anthracite headlining, JCW sport seats, Cruise control with brake function, JCW door sill finishers)', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eda77cea-beb9-4840-9a53-0e7a048b7c9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-05 07:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517475, 'registration': 'WD68SFX', 'account': 'MER023', 'make': 'MINI', 'model': 'CONVERTIBLE', 'derivative': '1.5 Cooper II 2dr', 'mileage': 34783, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-02-05', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/WD68SFX/2025-11-27/image/4588ebdf-63b0-4300-b6a7-4a246ba11c57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/d08e1c92-e555-4be8-b617-94fba88ef4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/55302db7-8646-4c10-ad6a-eff9b25f9445_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/c47bb734-c777-498a-bf5c-83417bf684c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/60a9bbb6-62f3-4763-bc2c-e07389c7e5ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/da187a0d-df6d-4b5e-832e-a1e0d9c96256_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/bea286eb-2c2b-4172-bd4a-d857d295f1de_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/afd3c6bf-dd10-472a-85cc-401781edfdb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD68SFX/2025-11-27/image/b105f866-183e-4787-b62d-5f77f855c042_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 01/25 24K idrive 11/20 7k 10/21 7.8k', 'remarks': 'SKEY - Navigation (including Apple CarPlay), John Cooper Works Sport Pack (includes 17" Track Spoke alloy wheels in black, Performance Control, JCW sport leather steering wheel, JCW rear spoiler, JCW aerodynamic kit, Anthracite headlining, JCW sport seats, Cruise control with brake function, JCW door sill finishers)', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eda77cea-beb9-4840-9a53-0e7a048b7c9a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-05 07:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-05 07:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5545fd41-d151-53d7-84d8-81f5483bc2f6 with scrape type 2
2025-12-05 07:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5545fd41-d151-53d7-84d8-81f5483bc2f6 with scrape type 2
2025-12-05 07:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5545fd41-d151-53d7-84d8-81f5483bc2f6, identifier: 117517475
2025-12-05 07:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-05 07:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475
2025-12-05 07:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5545fd41-d151-53d7-84d8-81f5483bc2f6 with identifier: 117517475 to the API
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275545fd41-d151-53d7-84d8-81f5483bc2f6%27 HTTP/1.1" 200 None
2025-12-05 07:01:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5545fd41-d151-53d7-84d8-81f5483bc2f6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 07:01:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 07:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117517475?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5545fd41-d151-53d7-84d8-81f5483bc2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD68SFX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517475',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'CONVERTIBLE',
 'odometer': 34783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'MINI CONVERTIBLE 1.5 Cooper II 2dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 2dr',
 'vin': None,
 'year': 2018}
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-05 07:01:47 [astonbarclay.gb] INFO: Saving data for 117517475: {'auction_closing_time': 1765274400.0, 'created_time': 1764184064.481605, 'last_price_update_time': 1764918107.237209}
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517475') HTTP/1.1" 204 0
2025-12-05 07:01:47 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 07:01:47 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 3}
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201764486107 HTTP/1.1" 200 None
2025-12-05 07:01:47 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (115 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-12-05T07_00_01.jl
2025-12-05 07:01:47 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 135544,
 'downloader/request_count': 157,
 'downloader/request_method_count/GET': 157,
 'downloader/response_bytes': 1382567,
 'downloader/response_count': 157,
 'downloader/response_status_count/200': 157,
 'elapsed_time_seconds': 98.28642,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 7, 1, 47, 464809, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 40,
 'item_dropped_reasons_count/DropItem': 40,
 'item_scraped_count': 115,
 'log_count/DEBUG': 2969,
 'log_count/ERROR': 44,
 'log_count/INFO': 3075,
 'memusage/max': 156426240,
 'memusage/startup': 127234048,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 79,
 'playwright/request_count/aborted': 43,
 'playwright/request_count/method/GET': 56,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 31,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 2,
 'response_received_count': 157,
 'scheduler/dequeued': 157,
 'scheduler/dequeued/memory': 157,
 'scheduler/enqueued': 157,
 'scheduler/enqueued/memory': 157,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 156,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.9587073475241845,
 'scrapy-zyte-api/mean_response_seconds': 3.9610780708623143,
 'scrapy-zyte-api/processed': 156,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 156,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 155,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 156,
 'scrapy-zyte-api/request_args/httpResponseBody': 156,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 156,
 'scrapy-zyte-api/request_args/url': 156,
 'scrapy-zyte-api/status_codes/200': 156,
 'scrapy-zyte-api/success': 156,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 5, 7, 0, 9, 178389, tzinfo=datetime.timezone.utc)}
2025-12-05 07:01:47 [scrapy.core.engine] INFO: Spider closed (finished)

/2/log/utf8/sourcing_v2/astonbarclay.gb/task_36_2025-12-05T07_00_01/?job_finished=True

http://scrapyd-2:6800/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-05T07_00_01.log