2026-03-30 15:15:22 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable

2026-03-30 15:15:22 [common.utils.decorators] ERROR: Payload: {"id": "202508185538805", "stockItemId": "8a4206e198bd6ae20198bd82996c506f", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Dodge RAM 1500 AWD TRX Hennessey Mammoth 900 6.0 4dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Dodge RAM", "subtitle": "1500 AWD TRX Hennessey Mammoth 900 4dr", "__typename": "Heading"}, "attentionGrabber": "RHD TRX HENNESSEY MAMMOTH 900", "rrp": null, "price": 149989, "priceGBX": 14998900, "priceExcludingFees": 149989, "priceExcludingFeesGBX": 14998900, "suppliedPrice": 149989, "suppliedPriceGBX": 14998900, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "NO_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2021-01-01", "homeDeliveryRegionCodes": null, "priceExcludingVat": 149989, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": null, "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10032600", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10032600", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 8, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "Broxbournebury Mansion, White Stubbs Lane", "addressTwo": null, "town": "Broxbourne", "county": "Hertfordshire", "postcode": "EN10 7PY", "latLong": "51.7462744,-0.0415535", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "http://www.brooklynsmotors.co.uk", "__typename": "Link"}, "phoneNumber1": "(07537) 164503", "phoneNumber2": "(01992) 843067", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "BROOKYLNS", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 62, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/65ca751b433f42718b54d2cacc88fdd2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/62488675de8d405c8937cc5a6d541c40.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e36e7daac1144902be3b26a97a7ca8f5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f985fb43ed68450f9feee54e734e5ae3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0fa54aecd2a4acabc27b19e3684812a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eac123cc6444a968fdec39c0e6c54e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc4add8ebb9941668ce6049f9e86b36e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d3d00205da8c467bb12046fde8bb23fd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f8f2e293bc24bcfbdcba79b6038b8a1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f6ee72700ecd4f68a2dbb15a868d454a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/12b080b628454bb7a4b413070b43c990.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0c9bb4891ed3469f8cb1e95ca1a02c5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ddde5044e6ce4545822c5bf6c0e2e407.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/91f7221df0ba4721bc0209767cf774e6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/191ecc864df64e5492c7cff2ef8316aa.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/45f9a85f3a244920966e1fcfc5daabe1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0d276ca64611489ba272afb15d2c8100.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2bc165e3653447d97c4e23947fccd77.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4e1a46620359449f981c1409328635a2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/828e50460b8945e2963645f0c7f998d6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/686a03f566024caa9e98fb7803aae48b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/48f878445a154fe0b64a04bb2bc12162.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3f954651be414ecda3b3cbea10656f00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/940ce437308a4327872f74d39df2250f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e624b12ce8314ace8411baf1a824d894.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dd99d66f8ea4478b931bac9ed8bc6ca6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c7592083bb014e94baf86dafa31986f1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ceee1eb40f8a4970aa00bb85d27c027e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0ae2235c65364ee6a55ad72387c56a00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/706b9fd35f9641c1adfd40999ebde3cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f505f3c2f1dd423397e2d4954899a6ac.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cbc93e79578e404a92a10c109faa54e9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/acee58c0a6864e49baf493afb1fc2377.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/539b84d37e5a4235a9a2e984e3484d8c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f18c6d08f30449639b75bb36f48aa3ba.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eceb93f911146e98e1fbe83bb858744.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7d5e8c3844924ee2accbdaac1cd43145.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3586f500b9844378973391b5e712f5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2b49d119aee4854870bc167d020ce09.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f3213432d9340cdb05fbc33926fd0e4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4ce698197c3047c09fd3a8e819f3e68b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/98365be82337449cae33abab503bdd2e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/27559db4f69e492ca17d18c750783940.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/adc43b3d4b364ed8a192f7c3967e491a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aa6d1024a7864d6a9683deefb98c993f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/df817ddf08c9427bad3fe896c22c85f9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ec32650b921440309adb7c4c824f2f08.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3be0664096f4c789978073362149fdc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a23be2fbe8194dd28a274bb88a5b7910.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/099a6fda252c4b078d7c8fae79ef36b7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/af8a05e3203f4f0dbff50ca607f44848.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5584f1df0374086ba7914391fb9c6e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0a33712a251741dd9ede824f8b379dca.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/97bb3ec8c4c44bbcb08a434dccc2d4e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 7000, "unit": "MILE", "__typename": "Mileage"}, "plate": "70", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "BROOKYLNS", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "BROXBOURNE", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 164503", "phoneNumberTwo": "(01992) 843067", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Brooklyns Motors would like to present to you this 1 of 1 RHD Dodge Ram Truck TRX + Hennessey Engine Up Grade, The MAMMOTH 900 BHP, Specification as follows: TRX Level 2 Equipment Group, Multifunction Heated Steering Wheel with Paddle Shift, Leather + Alcantara + Carbon Fibre Insert, Heads Up Display, Black leather Electric Heated Seats, Ventilated Seats, TRX Embroidaries, Hennessy Embroideries, Interior Carbon Fibre Inlays, Alcantara Finish, Touch Screen Navigation System, Harmon/Kardon Premium Sound, Bluetooth Audio, Bluetooth Phone Prep, Remote-Proximity Keyless Entry, Electric Panoramic Glass Roof, Electric Blind, Privacy Glass, Dual A/c Climate Control, Electric Folding Mirrors, Electric Rear Roll Cover, Electric Mopar Side Steps, MAMMOTH off Road Kit - Custom Front Bumper, Custom Rear Bumper, LED Lights in Front Bumper, LED Centre High Mounted Stop Lamp, Trailer-Tow Group + Light Check + Tyre Monitoring System, Bed Utility Group, 2 x keys, Ghost Security System, Diamond Black Crystal Pearl-Coat Exterior Paint, 20-Inch Hennessy 10 Spoke Saturn Finish Alloys with 35-Inch Off Road Tyres, Competitive Finance Rates available, 10 Months Warranty-Wise Warranty Remaining.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": 2, "vehicleCondition": null, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": 900, "unit": "BHP", "__typename": "Power"}, "sizeLitres": null, "sizeCC": 6, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": null, "axleConfig": null, "ulezCompliant": false, "doors": 4, "bodyType": "Pickup", "cabType": "Unlisted", "rawBodyType": "Pickup", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Dodge", "model": "RAM", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": "Black interior colour", "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdfb60490>

2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdf54ff10>

2.11.2

127.0.0.1:6023

3ec23a1a535c08dc

2026-03-30 15:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']

2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>

2026-03-30 15:15:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

2026-03-30 15:15:12 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:15:12 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: _job: 4ad108d42c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:15:12 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:15:12 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:15:12 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:15:12 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:15:12 [scrapy.extensions.telnet] INFO: Telnet Password: 3ec23a1a535c08dc
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:15:12 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 15:15:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:15:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:15:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:15:12 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:15:12 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:15:12 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:15:12 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:15:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:15:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 15:15:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:15:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:15:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:15:17 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10032600 and multipost_profile_id: 3ae8a9fb-e062-486a-b5f3-2955e6569ef4 and job_id: 4ad108d42c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10032600&sort=price-asc
2026-03-30 15:15:17 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10032600, page: 1
2026-03-30 15:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 9
2026-03-30 15:15:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 15:15:19 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271056229%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271056229: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261027512%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261027512: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010306923%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603010306923: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169962661%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169962661: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185538805%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508185538805: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506243810554%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506243810554: 1

2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c with identifier 202303235539990
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c
2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 262,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Vat Qualifying Vehicle | Interior Carbon Fibre Package | '
                'Carbon Engine Cover | Suspension Lifter System| High Premium '
                'Sound System | 20" Birdcage Diamond Cut Dark Miron Finish | '
                'Carbon Macrotwill Trim | Alcantara Steering Wheel With Carbon '
                'Fibre | E-LSD Transmission | Home Link | Remote Garage Opener '
                '| 6 Way Power Sport Seats | Active Shift Paddles in Carbon | '
                'Carbon Fibre Cluster Cap | Rear Parking Camera With Dynamic '
                'Guide Lines | FibreGlass Hood | Cruise Control | Heated Front '
                'Seats | Specific Side View Mirrors | Extended Alcantara '
                'Interior Laser Effect | Carbon Door Sills | Carbon Ceramic '
                'Brakes | Blue Brake Calipers | Rear Electronic Differential | '
                'Cyber Security Gateway | VAT Qualifying Vehicle | Jan 2022 '
                'Registered Vehicle | Manufactures Warranty Until 2025 | 1st '
                'Service Recently Carried Out by Maserati | 1 Owner Vehicle | '
                '2x Keys | Competitive Finance Rates Available.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 621,
 'fuel_type': 'Petrol',
 'id': '10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202303235539990',
 'listing': 'directbuy',
 'location': 'Broxbourne, Hertfordshire',
 'make': 'Maserati',
 'model': 'MC20',
 'odometer': 1000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/a81012abfd7646229371fb3f56406bf3.jpg',
                'https://m.atcdn.co.uk/a/media/95a267d0858d4eddaeb7fed71297fe68.jpg',
                'https://m.atcdn.co.uk/a/media/e20682f050314b458b0aa918d9e0a5ff.jpg',
                'https://m.atcdn.co.uk/a/media/56bf0920cf1b41fcbbe9946d1d1ee645.jpg',
                'https://m.atcdn.co.uk/a/media/1434a38be63a499283ae9b79f45496a3.jpg',
                'https://m.atcdn.co.uk/a/media/88e869ef26ed44f9a360f978361cc6ee.jpg',
                'https://m.atcdn.co.uk/a/media/39c8d5f0e9c34e02b1993cab33da226b.jpg',
                'https://m.atcdn.co.uk/a/media/33c545c5ba8f4308a6105d3018cc28c4.jpg',
                'https://m.atcdn.co.uk/a/media/908172752934456c90a90b54200117ca.jpg',
                'https://m.atcdn.co.uk/a/media/0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646360,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a81012abfd7646229371fb3f56406bf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786621,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/95a267d0858d4eddaeb7fed71297fe68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 884410,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e20682f050314b458b0aa918d9e0a5ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918899,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/56bf0920cf1b41fcbbe9946d1d1ee645.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574565,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1434a38be63a499283ae9b79f45496a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697605,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/88e869ef26ed44f9a360f978361cc6ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593567,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/39c8d5f0e9c34e02b1993cab33da226b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615777,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/33c545c5ba8f4308a6105d3018cc28c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552189,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/908172752934456c90a90b54200117ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646925,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg',
             'Width': 2048}],
 'price': 155000,
 'price_includes_vat': True,
 'registration_date': '2022-01-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Maserati MC20 3.0 V6 DCT Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'year': 2022}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202303235539990%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202303235539990: {'created_time': 1774883723.9094, 'last_price_update_time': 1774883723.909411}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202303235539990') HTTP/1.1" 204 0
2026-03-30 15:15:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:15:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:15:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4ad108d42c1f11f18e133aacc95538c6
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-30 15:15:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:15:24 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587724 HTTP/1.1" 200 None
2026-03-30 15:15:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (9 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6.jl
2026-03-30 15:15:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 71822,
 'downloader/request_count': 2,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 393822,
 'downloader/response_count': 2,
 'downloader/response_status_count/200': 2,
 'elapsed_time_seconds': 12.201739,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 15, 15, 24, 963241, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 9,
 'log_count/DEBUG': 298,
 'log_count/ERROR': 2,
 'log_count/INFO': 205,
 'memusage/max': 149487616,
 'memusage/startup': 149487616,
 'request_depth_max': 1,
 'response_received_count': 2,
 'scheduler/dequeued': 2,
 'scheduler/dequeued/memory': 2,
 'scheduler/enqueued': 2,
 'scheduler/enqueued/memory': 2,
 'scrape_type/new': 9,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 2,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.2422172240912914,
 'scrapy-zyte-api/mean_response_seconds': 1.373922634869814,
 'scrapy-zyte-api/processed': 2,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 1,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/url': 2,
 'scrapy-zyte-api/status_codes/200': 2,
 'scrapy-zyte-api/success': 2,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 30, 15, 15, 12, 761502, tzinfo=datetime.timezone.utc)}
2026-03-30 15:15:25 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdfb60490>
2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdf54ff10>

/2/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6/?job_finished=True&ui=mobile

http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6.log