2026-03-26 14:34:24 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None

2026-03-26 14:34:24 [common.utils.decorators] ERROR: Payload: {"id": "202511047650195", "stockItemId": "8a42c3e29a34d100019a4f9776c61bcc", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Lamborghini Urus V8 4.0 Estate Automatic Petrol 0dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock", "uvl"], "dueAtSeller": null, "motExpiry": "2026-01-06T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Lamborghini Urus", "subtitle": "V8 4.0 Estate Automatic Petrol", "__typename": "Heading"}, "attentionGrabber": "AKRAPOVIC|LAMBO WARRANTY", "rrp": null, "price": 174990, "priceGBX": 17499000, "priceExcludingFees": 174990, "priceExcludingFeesGBX": 17499000, "suppliedPrice": 174990, "suppliedPriceGBX": 17499000, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "NO_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2022-03-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 174990, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "L****MO", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "17499", "__typename": "FinanceDefaults"}, "hasFinanceInformation": true, "retailerId": "10021908", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10021908", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 27, "van": 4, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447451283796", "__typename": "AssignedNumber"}, "atAwards": [{"year": "2020", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2023", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "RAC Warranties", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/racWarranties.jpg", "__typename": "Brand"}, {"name": "Warranty Wise warranty", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantyWise.jpg", "__typename": "Brand"}, {"name": "Close Brothers Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/closeMotors.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447451283796", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "F12 Performance", "addressTwo": "APEX WAY", "town": "Leeds", "county": "Yorkshire", "postcode": "LS11 5LN", "latLong": "53.786173,-1.544368", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.f12performance.co.uk/", "__typename": "Link"}, "phoneNumber1": "(0113) 427 7906", "phoneNumber2": "(07537) 164661", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "F12 Performance", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "CHATVISITOR", "CODRIVER", "DFIN", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home", "Arrange a time to suit you", "Ask our experts any questions"], "paragraphs": ["F1 Performance has an outstanding 5 Star service, therefore we will always go the extra mile for our customers to keep them comfortable and satisfied in their transaction."], "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 61, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/f61d2ce9bd6448958e829bb9c18470cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4de7a16789c4461afd1e6614e807415.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96812e184ce842ecbac0b0527cc3f27f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79112063e8524bd1ace43db04a4cd102.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/67a6e276404f4290a77f456cb5a7cc18.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4b88f5a71cb54e70ad91d1bd6e4c8789.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/69b543bb17ef40edac0ac5ca2b2403e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc360b6c547545ef84f3bd8de5eef472.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e66f410d2df54f708a81c0498cb21648.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bf4a25e3ca274f9e81f79c5339940f74.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cce3b165992b4a788106779d597eb5bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8c0caf41165b43ccad14c6cbb757ba43.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f2a7b61e4698408abe65bda62f604846.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8695cea20fe04895bff020f41e2aa898.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4de7a16789c4461afd1e6614e807415.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/153fa5b9986c4271bd8033abd4067632.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96812e184ce842ecbac0b0527cc3f27f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8fd7363a1969408cb28978d958e6378b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d97949883e034572a768614105e892cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5de11dfea7a44e68aed0d46f6c9edad2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/31998c8dbc064bc4af3e18d79e39502d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e8af8dfa3b6143a9adb5c84526a5bbd1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2a162af45dbf4871966243440b345f1b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Roof", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96066837bf644780a92e081ded2c128e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7d788bcdec5c42929b98b1e8a53dacde.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/966890bb1f1d45e1be3acae107b9f485.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1049e75b6b0149ccba04513265ecc570.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/22fca3fe1ad64b3889490aa80563b563.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4bbe81706c344fcb25371db76c0d643.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a1e7e0b4a29e4f78a2447ff2f4ecd04b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5049c24ec92c4ada9bd6616d84a4b83e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/19fb3c5526604cb6a4a9a5a38f3689e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Handle Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79112063e8524bd1ace43db04a4cd102.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0c05d98540bc400b874ef8a2698e2099.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a7212c66347a43cfbd272d825e3733ac.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wing Mirror", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4dbaf8e7a2844cd595e0f905dda9d767.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/54b3fb6adf1a4088ae4583807e250cb4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/12dc3807f06e43d1a2105291e3ab3d54.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7659275c1bfb4fd2921863b9f58c972d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aca7e05c6dce47e3b9cebf6a73345ae9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5e44f075b5fe43b1b055bc229b08d0bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9209fa9cff5e4b4da63100a2f437410e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/debf3c5aa8fe45ffa2846d3d30bec28d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/63692505de754a30a024360c0f75348c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f7a7b1b59753416fb81ff64ec5331e5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dfc7549f842a4f07ab730e749bd7c7a3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fe8bbd06a97842d59ba80f65912452db.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5fff332f1d2441f0a0b7defe210dd655.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e443a5824c864524956f748f7cc6928b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/21735265c1524a2888be002d6d0ecc61.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c738a31d288e469a8277b9088e0cfa36.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/70100f53dd794134b922fe26aa8ffbcd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b1e4b49a2df64edea9d93d904af7417e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fa37583e097c4f32927e1f59f3f62988.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dd59e43cac0e45f9a94760415d9b176c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1a42f1405aa44a589b8ac7a7af418dda.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/67a6e276404f4290a77f456cb5a7cc18.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4b88f5a71cb54e70ad91d1bd6e4c8789.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/69b543bb17ef40edac0ac5ca2b2403e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc360b6c547545ef84f3bd8de5eef472.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8c0caf41165b43ccad14c6cbb757ba43.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 24600, "unit": "MILE", "__typename": "Mileage"}, "plate": "22", "year": 2022, "vehicleCheckId": "a8dc5cc574464dafb5dcf10ca2b33393", "vehicleCheckStatus": "PASSED", "vehicleCheckSummary": {"type": "FULL", "title": "Passed with advisory", "performed": "2026-01-11", "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "HIGH_RISK", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "MILEAGE_DISCREPANCY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "COLOUR_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "PRIVATE_FINANCE", "failed": true, "advisory": true, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "TRADE_FINANCE", "failed": false, "advisory": false, "critical": false, "warning": false, "__typename": "VehicleCheck"}, {"key": "REGISTRATION_CHANGED", "failed": true, "advisory": false, "critical": true, "warning": true, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "F12 Performance", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "CHATVISITOR", "CODRIVER", "DFIN", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "LEEDS", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(0113) 427 7906", "phoneNumberTwo": "(07537) 164661", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Stunning Lamborghini Urus, with extended Lamborghini warranty until March 2026, recently fitted brand new set of tyres, finished in black metallic paint, black leather interior with orange contrast stitching, featuring Akrapovic exhaust system, gloss black exterior pack including rear diffuser and door trims, panoramic glass sliding roof, head up display, heated steering wheel, carbon fibre wrapped wingmirrors, adaptive cruise control, 360 surround parking camera and sensors, bluetooth connectivity, satellite navigation and more", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Right Hand Drive", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": {"co2Emission": 325, "unit": "g/km", "__typename": "Co2Emissions"}, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 4, "sizeCC": 3996, "manufacturerEngineSize": 4, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 5, "axleConfig": null, "ulezCompliant": true, "doors": 0, "bodyType": "SUV", "cabType": "Unlisted", "rawBodyType": "SUV", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Lamborghini", "model": "Urus", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Four Wheel Drive", "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf94255b10>

2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf93158490>

2.11.2

127.0.0.1:6023

7976216440b0af16

2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg> (referer: https://www.autotrader.co.uk/)

2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg>

2026-03-26 14:33:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

2026-03-26 14:33:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 14:33:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: _job: d0d822b6292011f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 14:33:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 14:33:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 14:33:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 14:33:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 14:33:59 [scrapy.extensions.telnet] INFO: Telnet Password: 7976216440b0af16
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 14:33:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 14:33:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:33:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 14:33:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 14:33:59 [scrapy.core.engine] INFO: Spider opened
2026-03-26 14:33:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:33:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 14:33:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 14:33:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 14:33:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 14:33:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 14:33:59 [scrapy-playwright] INFO: Starting download handler

2026-03-26 14:33:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:34:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10021908 and multipost_profile_id: 00313984-33f8-483e-8f2e-7a88913a2950 and job_id: d0d822b6292011f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/f12-performance-10021908
2026-03-26 14:34:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10021908, page: 1
2026-03-26 14:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 27
2026-03-26 14:34:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-26 14:34:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210886600%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210886600: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110611925%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110611925: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594800%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110594800: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090524718%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090524718: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355824%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355824: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355823%27 HTTP/1.1" 200 None

2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 49c56354-287f-5f92-9b98-ccef83175386
2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Just arrived into stock, stunning 1 owner Discovery '
                'Commercial, V A T qualifying finished in black paint with '
                'black leather interior, full exterior black pack, electric '
                'folding tow bar, black exterior pack, heated steering wheel, '
                'heated and cooled seats, air suspension, 360 parking camera '
                'and sensors, adaptive cruise control, Meridian surround sound '
                'system, bluetooth connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': '49c56354-287f-5f92-9b98-ccef83175386',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601089009677',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Discovery',
 'odometer': 20500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c56354-287f-5f92-9b98-ccef83175386/49c56354-287f-5f92-9b98-ccef83175386_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274029,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg',
             'Width': 1280}],
 'price': 62990,
 'price_includes_vat': True,
 'registration_date': '2024-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Land Rover Discovery 3.0 D350 MHEV Dynamic HSE SUV 5dr Diesel Auto '
          '4WD Euro 6 (s/s) (350 ps)',
 'transmission': 'automatic',
 'trim': 'Dynamic HSE',
 'year': 2024}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601089009677%27 HTTP/1.1" 200 None
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601089009677: {'created_time': 1774535665.200322, 'last_price_update_time': 1774535665.20033}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601089009677') HTTP/1.1" 204 0
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b757010>
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce9f113-466e-5364-b27f-64a7bc91bf1d/6ce9f113-466e-5364-b27f-64a7bc91bf1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b5806f50ce9413c9fe4edeaf69c49ec.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg saved to cache
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d sending to next pipeline
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6ce9f113-466e-5364-b27f-64a7bc91bf1d with identifier 202503200375677
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d
2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Stunning VAT qualifying Porsche 992.2 Carrera, brand new '
                'delivery miles, finished in Vanadium grey metallic paint over '
                'red and black two tone leather, excellent specification '
                'includes the rare Porsche factory fitted Aerokit option in '
                'high gloss black, panoramic glass sliding sunroof, sports '
                'exhaust system with silver tailpipes, HD matrix LED '
                'headlights, 20" front 21" rear Carrera classic alloy wheels, '
                'sports chrono package, BOSE surround sound system, sports '
                'seats plus with 4 way electrical adjustment, power steering '
                'plus, wheel centres with full colour Porsche crest, Porsche '
                'LED door courtesy lights, windscreen with grey top tint, and '
                'more.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 389,
 'fuel_type': 'Petrol',
 'id': '6ce9f113-466e-5364-b27f-64a7bc91bf1d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202503200375677',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Porsche',
 'model': '911',
 'odometer': 20,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce9f113-466e-5364-b27f-64a7bc91bf1d/6ce9f113-466e-5364-b27f-64a7bc91bf1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306415,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg',
             'Width': 1280}],
 'price': 100990,
 'price_includes_vat': True,
 'registration_date': '2024-11-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 992 Carrera Coupe 2dr Petrol PDK Euro 6 (s/s) (394 '
          'ps)',
 'transmission': 'automatic',
 'trim': '992 Carrera',
 'year': 2024}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202503200375677%27 HTTP/1.1" 200 None
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202503200375677: {'created_time': 1774535665.368496, 'last_price_update_time': 1774535665.368504}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202503200375677') HTTP/1.1" 204 0
2026-03-26 14:34:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 14:34:25 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 14:34:25 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item d0d822b6292011f18f76c264925fbcfa
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 14:34:25 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 7, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 14:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773239666 HTTP/1.1" 200 None
2026-03-26 14:34:26 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (27 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa.jl
2026-03-26 14:34:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 2,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 2,
 'downloader/request_bytes': 220644,
 'downloader/request_count': 32,
 'downloader/request_method_count/GET': 27,
 'downloader/request_method_count/POST': 5,
 'downloader/response_bytes': 8604016,
 'downloader/response_count': 30,
 'downloader/response_status_count/200': 30,
 'elapsed_time_seconds': 26.619867,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 14, 34, 26, 493697, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 27,
 'log_count/DEBUG': 488,
 'log_count/ERROR': 2,
 'log_count/INFO': 432,
 'memusage/max': 146845696,
 'memusage/startup': 146845696,
 'photo_download_count': 25,
 'request_depth_max': 3,
 'response_received_count': 5,
 'scheduler/dequeued': 32,
 'scheduler/dequeued/memory': 32,
 'scheduler/enqueued': 32,
 'scheduler/enqueued/memory': 32,
 'scrape_type/new': 27,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 5,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.226278893370181,
 'scrapy-zyte-api/mean_response_seconds': 4.403694330155849,
 'scrapy-zyte-api/processed': 5,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 4,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 5,
 'scrapy-zyte-api/request_args/httpRequestBody': 5,
 'scrapy-zyte-api/request_args/httpRequestMethod': 5,
 'scrapy-zyte-api/request_args/httpResponseBody': 5,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 5,
 'scrapy-zyte-api/request_args/url': 5,
 'scrapy-zyte-api/status_codes/200': 5,
 'scrapy-zyte-api/success': 5,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 14, 33, 59, 873830, tzinfo=datetime.timezone.utc)}
2026-03-26 14:34:26 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf94255b10>
2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf93158490>

/4/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa/?job_finished=True

http://scrapyd-3:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa.log