2026-01-28 13:10:54 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable

2026-01-28 13:10:54 [common.utils.decorators] ERROR: Payload: {"id": "202508185538805", "stockItemId": "8a4206e198bd6ae20198bd82996c506f", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Dodge RAM 1500 AWD TRX Hennessey Mammoth 900 6.0 4dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Dodge RAM", "subtitle": "1500 AWD TRX Hennessey Mammoth 900 4dr", "__typename": "Heading"}, "attentionGrabber": "RHD TRX HENNESSEY MAMMOTH 900", "rrp": null, "price": 155000, "priceGBX": 15500000, "priceExcludingFees": 155000, "priceExcludingFeesGBX": 15500000, "suppliedPrice": 155000, "suppliedPriceGBX": 15500000, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "NO_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2021-01-01", "homeDeliveryRegionCodes": null, "priceExcludingVat": 155000, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": null, "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10032600", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10032600", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 8, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "Broxbournebury Mansion, White Stubbs Lane", "addressTwo": null, "town": "Broxbourne", "county": "Hertfordshire", "postcode": "EN10 7PY", "latLong": "51.7462744,-0.0415535", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "http://www.brooklynsmotors.co.uk", "__typename": "Link"}, "phoneNumber1": "(07537) 164503", "phoneNumber2": "(01992) 843067", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "BROOKYLNS", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 62, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/65ca751b433f42718b54d2cacc88fdd2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/62488675de8d405c8937cc5a6d541c40.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e36e7daac1144902be3b26a97a7ca8f5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f985fb43ed68450f9feee54e734e5ae3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0fa54aecd2a4acabc27b19e3684812a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eac123cc6444a968fdec39c0e6c54e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc4add8ebb9941668ce6049f9e86b36e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d3d00205da8c467bb12046fde8bb23fd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f8f2e293bc24bcfbdcba79b6038b8a1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f6ee72700ecd4f68a2dbb15a868d454a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/12b080b628454bb7a4b413070b43c990.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0c9bb4891ed3469f8cb1e95ca1a02c5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ddde5044e6ce4545822c5bf6c0e2e407.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/91f7221df0ba4721bc0209767cf774e6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/191ecc864df64e5492c7cff2ef8316aa.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/45f9a85f3a244920966e1fcfc5daabe1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0d276ca64611489ba272afb15d2c8100.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2bc165e3653447d97c4e23947fccd77.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4e1a46620359449f981c1409328635a2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/828e50460b8945e2963645f0c7f998d6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/686a03f566024caa9e98fb7803aae48b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/48f878445a154fe0b64a04bb2bc12162.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3f954651be414ecda3b3cbea10656f00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/940ce437308a4327872f74d39df2250f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e624b12ce8314ace8411baf1a824d894.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dd99d66f8ea4478b931bac9ed8bc6ca6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c7592083bb014e94baf86dafa31986f1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ceee1eb40f8a4970aa00bb85d27c027e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0ae2235c65364ee6a55ad72387c56a00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/706b9fd35f9641c1adfd40999ebde3cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f505f3c2f1dd423397e2d4954899a6ac.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cbc93e79578e404a92a10c109faa54e9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/acee58c0a6864e49baf493afb1fc2377.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/539b84d37e5a4235a9a2e984e3484d8c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f18c6d08f30449639b75bb36f48aa3ba.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eceb93f911146e98e1fbe83bb858744.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7d5e8c3844924ee2accbdaac1cd43145.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3586f500b9844378973391b5e712f5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2b49d119aee4854870bc167d020ce09.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f3213432d9340cdb05fbc33926fd0e4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4ce698197c3047c09fd3a8e819f3e68b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/98365be82337449cae33abab503bdd2e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/27559db4f69e492ca17d18c750783940.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/adc43b3d4b364ed8a192f7c3967e491a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aa6d1024a7864d6a9683deefb98c993f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/df817ddf08c9427bad3fe896c22c85f9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ec32650b921440309adb7c4c824f2f08.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3be0664096f4c789978073362149fdc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a23be2fbe8194dd28a274bb88a5b7910.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/099a6fda252c4b078d7c8fae79ef36b7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/af8a05e3203f4f0dbff50ca607f44848.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5584f1df0374086ba7914391fb9c6e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0a33712a251741dd9ede824f8b379dca.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/97bb3ec8c4c44bbcb08a434dccc2d4e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 7000, "unit": "MILE", "__typename": "Mileage"}, "plate": "70", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "BROOKYLNS", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "BROXBOURNE", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 164503", "phoneNumberTwo": "(01992) 843067", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Brooklyns Motors would like to present to you this 1 of 1 RHD Dodge Ram Truck TRX + Hennessey Engine Up Grade, The MAMMOTH 900 BHP, Specification as follows: TRX Level 2 Equipment Group, Multifunction Heated Steering Wheel with Paddle Shift, Leather + Alcantara + Carbon Fibre Insert, Heads Up Display, Black leather Electric Heated Seats, Ventilated Seats, TRX Embroidaries, Hennessy Embroideries, Interior Carbon Fibre Inlays, Alcantara Finish, Touch Screen Navigation System, Harmon/Kardon Premium Sound, Bluetooth Audio, Bluetooth Phone Prep, Remote-Proximity Keyless Entry, Electric Panoramic Glass Roof, Electric Blind, Privacy Glass, Dual A/c Climate Control, Electric Folding Mirrors, Electric Rear Roll Cover, Electric Mopar Side Steps, MAMMOTH off Road Kit - Custom Front Bumper, Custom Rear Bumper, LED Lights in Front Bumper, LED Centre High Mounted Stop Lamp, Trailer-Tow Group + Light Check + Tyre Monitoring System, Bed Utility Group, 2 x keys, Ghost Security System, Diamond Black Crystal Pearl-Coat Exterior Paint, 20-Inch Hennessy 10 Spoke Saturn Finish Alloys with 35-Inch Off Road Tyres, Competitive Finance Rates available, 10 Months Warranty-Wise Warranty Remaining.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": 2, "vehicleCondition": null, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": 900, "unit": "BHP", "__typename": "Power"}, "sizeLitres": null, "sizeCC": 6, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": null, "axleConfig": null, "ulezCompliant": false, "doors": 4, "bodyType": "Pickup", "cabType": "Unlisted", "rawBodyType": "Pickup", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Dodge", "model": "RAM", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": "Black interior colour", "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-01-28 13:10:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa8800a1950>

2026-01-28 13:10:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa8800a21d0>

2.11.2

127.0.0.1:6024

b22ef19e6d9433e4

2026-01-28 13:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']

2026-01-28 13:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>

2026-01-28 13:10:14 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 8 items (at 0 items/min)

2026-01-28 13:06:13 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 13:06:13 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 13:06:13 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-01-28 13:06:13 [auto_selling_autotrader.co.uk] INFO: _job: 2658df5afc3011f0a599c2c555c92d63, SCRAPY_JOB: None
2026-01-28 13:06:13 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 13:06:14 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 13:06:14 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 13:06:14 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 13:06:14 [scrapy.extensions.telnet] INFO: Telnet Password: b22ef19e6d9433e4
2026-01-28 13:06:14 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']

2026-01-28 13:06:14 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/2658df5afc3011f0a599c2c555c92d63.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 13:06:14 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 13:06:14 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 13:06:14 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 13:06:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-01-28 13:06:14 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 13:06:14 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-01-28 13:06:14 [scrapy.core.engine] INFO: Spider opened
2026-01-28 13:06:14 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-28 13:06:14 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-01-28 13:06:14 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-01-28 13:06:14 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 13:06:14 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-01-28 13:06:14 [scrapy-playwright] INFO: Starting download handler
2026-01-28 13:06:14 [scrapy-playwright] INFO: Starting download handler
2026-01-28 13:06:19 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10032600 and multipost_profile_id: 3ae8a9fb-e062-486a-b5f3-2955e6569ef4 and job_id: 2658df5afc3011f0a599c2c555c92d63 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10032600&sort=price-asc
2026-01-28 13:06:19 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10032600, page: 1
2026-01-28 13:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 13:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 9
2026-01-28 13:06:20 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 13:06:20 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512228758277%27 HTTP/1.1" 200 None
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512228758277: 1
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512228758277, item: 202512228758277
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511218050055%27 HTTP/1.1" 200 None
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511218050055: 1
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511218050055, item: 202511218050055
2026-01-28 13:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157916334%27 HTTP/1.1" 200 None
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157916334: 1
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157916334, item: 202511157916334
2026-01-28 13:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185538805%27 HTTP/1.1" 200 None
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508185538805: 1
2026-01-28 13:06:20 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202508185538805, item: 202508185538805
2026-01-28 13:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 13:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185536647%27 HTTP/1.1" 200 None
2026-01-28 13:06:21 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508185536647: 1
2026-01-28 13:06:21 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202508185536647, item: 202508185536647

             'FileSizeInBytes': 625804,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/62488675de8d405c8937cc5a6d541c40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619188,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e36e7daac1144902be3b26a97a7ca8f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576770,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f985fb43ed68450f9feee54e734e5ae3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546326,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320318,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0fa54aecd2a4acabc27b19e3684812a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149716,
             'Height': 713,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2eac123cc6444a968fdec39c0e6c54e2.jpg',
             'Width': 1013},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419496,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc4add8ebb9941668ce6049f9e86b36e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414958,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462669,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3d00205da8c467bb12046fde8bb23fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446124,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7f8f2e293bc24bcfbdcba79b6038b8a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371335,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/41708ff6a9834ea6981ebc728dcf4762.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382339,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6ee72700ecd4f68a2dbb15a868d454a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380724,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/12b080b628454bb7a4b413070b43c990.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167772,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c9bb4891ed3469f8cb1e95ca1a02c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257155,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ddde5044e6ce4545822c5bf6c0e2e407.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193156,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/91f7221df0ba4721bc0209767cf774e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234636,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/45f9a85f3a244920966e1fcfc5daabe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185629,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/191ecc864df64e5492c7cff2ef8316aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156842,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d276ca64611489ba272afb15d2c8100.jpg',
             'Width': 2048}],
 'price': 155000,
 'price_includes_vat': True,
 'registration_date': '2021-01-01',
 'seller_name': None,
 'title': 'Dodge RAM 1500 AWD TRX Hennessey Mammoth 900 6.0 4dr',
 'transmission': 'automatic',
 'year': 2021}
2026-01-28 13:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185538805%27 HTTP/1.1" 200 None
2026-01-28 13:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508185538805: {'created_time': 1769605855.262673, 'last_price_update_time': 1769605855.262681}
2026-01-28 13:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508185538805') HTTP/1.1" 204 0
2026-01-28 13:10:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 13:10:55 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-01-28 13:10:55 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-01-28 13:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-01-28 13:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-01-28 13:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 2658df5afc3011f0a599c2c555c92d63
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-01-28 13:10:55 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-01-28 13:10:55 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 13:10:55 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 13:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-01-28 13:10:55 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-28 13:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 13:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201768309856 HTTP/1.1" 200 None
2026-01-28 13:10:56 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (9 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/2658df5afc3011f0a599c2c555c92d63.jl
2026-01-28 13:10:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 77014,
 'downloader/request_count': 10,
 'downloader/request_method_count/POST': 10,
 'downloader/response_bytes': 409270,
 'downloader/response_count': 10,
 'downloader/response_status_count/200': 10,
 'elapsed_time_seconds': 282.264079,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 13, 10, 56, 565701, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 9,
 'log_count/DEBUG': 502,
 'log_count/ERROR': 2,
 'log_count/INFO': 306,
 'memusage/max': 144465920,
 'memusage/startup': 126578688,
 'request_depth_max': 1,
 'response_received_count': 10,
 'scheduler/dequeued': 10,
 'scheduler/dequeued/memory': 10,
 'scheduler/enqueued': 10,
 'scheduler/enqueued/memory': 10,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 13,
 'scrapy-zyte-api/error_ratio': 0.23076923076923078,
 'scrapy-zyte-api/errors': 3,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 3,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 9.073787605855614,
 'scrapy-zyte-api/mean_response_seconds': 9.107196118868888,
 'scrapy-zyte-api/processed': 10,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 10,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 9,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 10,
 'scrapy-zyte-api/request_args/httpRequestBody': 10,
 'scrapy-zyte-api/request_args/httpRequestMethod': 10,
 'scrapy-zyte-api/request_args/httpResponseBody': 10,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 10,
 'scrapy-zyte-api/request_args/url': 10,
 'scrapy-zyte-api/status_codes/0': 3,
 'scrapy-zyte-api/status_codes/200': 10,
 'scrapy-zyte-api/success': 10,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 13, 6, 14, 301622, tzinfo=datetime.timezone.utc)}
2026-01-28 13:10:56 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-28 13:10:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa8800a1950>
2026-01-28 13:10:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa8800a21d0>

/1/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/2658df5afc3011f0a599c2c555c92d63/?job_finished=True&ui=mobile

http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/2658df5afc3011f0a599c2c555c92d63.log