2025-12-05 12:35:35 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None

2025-12-05 12:35:35 [common.utils.decorators] ERROR: Payload: {"id": "202510046884379", "stockItemId": "8a42c8d899aa70f70199af1b55164255", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Mitsubishi Lancer 2.0 EVO VI GSR 4dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock", "uvl"], "dueAtSeller": null, "motExpiry": "2026-09-29T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Mitsubishi Lancer", "subtitle": "2.0 EVO VI GSR 4dr", "__typename": "Heading"}, "attentionGrabber": "Ready to drive away! Rare car!", "rrp": null, "price": 24995, "priceGBX": 2499500, "priceExcludingFees": 24995, "priceExcludingFeesGBX": 2499500, "suppliedPrice": 24995, "suppliedPriceGBX": 2499500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "INC_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2016-04-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 20829.17, "vatToBePaidUpfront": 4165.83, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "S****AH", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10041004", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10041004", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [], "branding": {"accreditations": [], "brands": [{"name": "Warranty First warranty", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantyFirst.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"numberOfReviews": "10", "overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "Unit F, Limesquare Business Park", "addressTwo": "Bretton", "town": "Peterborough", "county": "Northamptonshire", "postcode": "PE3 8YQ", "latLong": "52.6025648,-0.2735026", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.baileysprestige-performance.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07537) 122042", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Baileys Prestige-Performance", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 36, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/153af27c3d424ee486c3b027fa1aec6b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f504408f508b45e9bbf40e41c77260e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bc453b8c7bb84ea199d0cddfa83a2c84.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/209ad8d4da1c42e5abf02d95a6f9c1ab.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d8eb412782834c71b28a22336c7348bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5b7dbc68e45d496a84be87e3ae94cea8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/76ebbc2b3e1e4cb8b50749fb72c0b794.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f82da34b2584476ea7b6898f8e228910.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ad592de40bce42f1bd3bad5e87d7507f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9d1b769874eb4bc6a664e870688f709b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d5418a3d488645c5b780ec19af959bbb.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3b2e220a15bc4753a37b3fb68ebc4bab.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4ecaee63a4bc4f0287a4345476ffd9e4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a7877691ef0e4bd8865625d16151e325.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e46bf380047f4aab83e3c4ef974d7964.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e833aab3a90f4d40982bbc0a579ee28b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41aa0974ade14566a1b68a23d60e2859.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4689af178a7e4be19189e4740986dbb6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6242f2d3d17548fe89d229483a58457b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d6743925ce02451c8ed0a0fa81251b35.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5d3d4e88dbe4ce5980cd827d1e0d645.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/25a384f91963480fa7e17dea834de73c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/42d1124cd8124272a135fcdca9722e75.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e091073dbd944d4d9742d083688c9981.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/341b4481c28e4f05a2a06f3ae021f587.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0941b5864579402daa8d8b2d26e6a18f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8f8e116f365f45e3866d17d43bf14761.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/80155c33c70846d6a113e70edac52d37.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b422456a83d44eaab5e052b1e369e097.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/31f1f0a3d3b6417ebd158cbf78d172cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d265b8d118ba427383de62274120a6a8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3080655de5d40a4a3345d64b599b9b8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/beb5c714773b4324b3d8038f4d7c08c2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9579df9c29534f8e96fff07ffaf8b27e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bd29f1dcc69945a7b132686a00cd17a5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/99e934e6c1fa404b991becac889c365c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Documentation", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 68000, "unit": "MILE", "__typename": "Mileage"}, "plate": "X", "year": 2000, "vehicleCheckId": null, "vehicleCheckStatus": "FAILED", "vehicleCheckSummary": {"type": "BASIC", "title": "Imported", "performed": null, "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": true, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "Baileys Prestige-Performance", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "PETERBOROUGH", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 122042", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "\u2b50\ufe0f FOR SALE \u2b50\ufe0f \u2796 1998 Mitsubishi Evolution VI, 68k miles mixture of KM/MILES, Good service history, Stunning example, Currently running 368.9BHP with dyno printout to prove - Priced at \u00a324,995 \ud83d\ude0d\n\n\u2705 97,443 miles mixture of KM & MILES working out at approximately 68k ish.\n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u2705 Mot expires - 29 September 2026\n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u2705 Great service history, comes with original Japanese book packs and the original key with wooden block, all uk paperwork also - See pictures \n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u26ab\ufe0f Here at Baileys Prestige & Performance we are extremely proud to offer this stunning Mitsubishi Evo VI, This car is in excellent condition and drives absolutely phenomenal an out and out head turner. The last owner was a very good friend of ours who had owned the car for the last 5 years. Prior to his and the former keepers ownership the car was owned by Torque GT who carried out the underside treatment, unfortunately it is undersealed however is mega solid underneath. Any inspection welcomed. Engine bay is in extremely good condition and looks great, all usual rust spots are very clean! Comes with a full years MOT. Stunning example, currently running just shy of 370BHP tuned by someone we trust very well Gary at APT, bolsters mega clean too. The car has had a timing belt replacement at 81k miles, alloy wheels have been freshly refurbished. Paintwork genuinely is so clean for the age of the vehicle. A true collectors car which are hard to come by in this condition this day and age. The photos of the car speak for themselves it really is a very clean example which drives superb, pulls extremely well, sounds spot. All in all a really well cared for example. \n\n\u26ab\ufe0f Absolutely gorgeous example which has been priced at \u00a324,995\n\n\u2b50\ufe0fFinance and extended warranties available\u2b50\ufe0f\n\n**Here at Baileys Prestige & Performance we go the extra mile to make sure you are getting the best service out there, whilst our cars undergo a full health check and are driven and tested, all essential work carried out with no expense spared, P/x Warranty available**", "colour": null, "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": 1360, "unit": "kg", "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": null, "manufacturerEngineSize": null, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": null, "axleConfig": null, "ulezCompliant": false, "doors": 4, "bodyType": "Saloon", "cabType": "Unlisted", "rawBodyType": "Saloon", "fuel": "Petrol", "transmission": "Manual", "style": null, "subStyle": null, "make": "Mitsubishi", "model": "Lancer", "trim": "EVO VI GSR", "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": null, "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2025-12-05 12:35:35 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable

2025-12-05 12:35:35 [common.utils.decorators] ERROR: Payload: {"id": "202510046884379", "stockItemId": "8a42c8d899aa70f70199af1b55164255", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Mitsubishi Lancer 2.0 EVO VI GSR 4dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock", "uvl"], "dueAtSeller": null, "motExpiry": "2026-09-29T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Mitsubishi Lancer", "subtitle": "2.0 EVO VI GSR 4dr", "__typename": "Heading"}, "attentionGrabber": "Ready to drive away! Rare car!", "rrp": null, "price": 24995, "priceGBX": 2499500, "priceExcludingFees": 24995, "priceExcludingFeesGBX": 2499500, "suppliedPrice": 24995, "suppliedPriceGBX": 2499500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "INC_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2016-04-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 20829.17, "vatToBePaidUpfront": 4165.83, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "S****AH", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10041004", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10041004", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [], "branding": {"accreditations": [], "brands": [{"name": "Warranty First warranty", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantyFirst.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"numberOfReviews": "10", "overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "Unit F, Limesquare Business Park", "addressTwo": "Bretton", "town": "Peterborough", "county": "Northamptonshire", "postcode": "PE3 8YQ", "latLong": "52.6025648,-0.2735026", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.baileysprestige-performance.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07537) 122042", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Baileys Prestige-Performance", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 36, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/153af27c3d424ee486c3b027fa1aec6b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f504408f508b45e9bbf40e41c77260e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bc453b8c7bb84ea199d0cddfa83a2c84.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/209ad8d4da1c42e5abf02d95a6f9c1ab.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d8eb412782834c71b28a22336c7348bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5b7dbc68e45d496a84be87e3ae94cea8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/76ebbc2b3e1e4cb8b50749fb72c0b794.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f82da34b2584476ea7b6898f8e228910.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ad592de40bce42f1bd3bad5e87d7507f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9d1b769874eb4bc6a664e870688f709b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d5418a3d488645c5b780ec19af959bbb.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3b2e220a15bc4753a37b3fb68ebc4bab.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4ecaee63a4bc4f0287a4345476ffd9e4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a7877691ef0e4bd8865625d16151e325.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e46bf380047f4aab83e3c4ef974d7964.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e833aab3a90f4d40982bbc0a579ee28b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41aa0974ade14566a1b68a23d60e2859.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4689af178a7e4be19189e4740986dbb6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6242f2d3d17548fe89d229483a58457b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d6743925ce02451c8ed0a0fa81251b35.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5d3d4e88dbe4ce5980cd827d1e0d645.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/25a384f91963480fa7e17dea834de73c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/42d1124cd8124272a135fcdca9722e75.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e091073dbd944d4d9742d083688c9981.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Engine", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/341b4481c28e4f05a2a06f3ae021f587.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0941b5864579402daa8d8b2d26e6a18f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8f8e116f365f45e3866d17d43bf14761.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/80155c33c70846d6a113e70edac52d37.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b422456a83d44eaab5e052b1e369e097.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/31f1f0a3d3b6417ebd158cbf78d172cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d265b8d118ba427383de62274120a6a8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3080655de5d40a4a3345d64b599b9b8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/beb5c714773b4324b3d8038f4d7c08c2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9579df9c29534f8e96fff07ffaf8b27e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bd29f1dcc69945a7b132686a00cd17a5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/99e934e6c1fa404b991becac889c365c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Documentation", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 68000, "unit": "MILE", "__typename": "Mileage"}, "plate": "X", "year": 2000, "vehicleCheckId": null, "vehicleCheckStatus": "FAILED", "vehicleCheckSummary": {"type": "BASIC", "title": "Imported", "performed": null, "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": true, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "Baileys Prestige-Performance", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "PETERBOROUGH", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 122042", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "\u2b50\ufe0f FOR SALE \u2b50\ufe0f \u2796 1998 Mitsubishi Evolution VI, 68k miles mixture of KM/MILES, Good service history, Stunning example, Currently running 368.9BHP with dyno printout to prove - Priced at \u00a324,995 \ud83d\ude0d\n\n\u2705 97,443 miles mixture of KM & MILES working out at approximately 68k ish.\n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u2705 Mot expires - 29 September 2026\n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u2705 Great service history, comes with original Japanese book packs and the original key with wooden block, all uk paperwork also - See pictures \n\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\u2796\n\n\u26ab\ufe0f Here at Baileys Prestige & Performance we are extremely proud to offer this stunning Mitsubishi Evo VI, This car is in excellent condition and drives absolutely phenomenal an out and out head turner. The last owner was a very good friend of ours who had owned the car for the last 5 years. Prior to his and the former keepers ownership the car was owned by Torque GT who carried out the underside treatment, unfortunately it is undersealed however is mega solid underneath. Any inspection welcomed. Engine bay is in extremely good condition and looks great, all usual rust spots are very clean! Comes with a full years MOT. Stunning example, currently running just shy of 370BHP tuned by someone we trust very well Gary at APT, bolsters mega clean too. The car has had a timing belt replacement at 81k miles, alloy wheels have been freshly refurbished. Paintwork genuinely is so clean for the age of the vehicle. A true collectors car which are hard to come by in this condition this day and age. The photos of the car speak for themselves it really is a very clean example which drives superb, pulls extremely well, sounds spot. All in all a really well cared for example. \n\n\u26ab\ufe0f Absolutely gorgeous example which has been priced at \u00a324,995\n\n\u2b50\ufe0fFinance and extended warranties available\u2b50\ufe0f\n\n**Here at Baileys Prestige & Performance we go the extra mile to make sure you are getting the best service out there, whilst our cars undergo a full health check and are driven and tested, all essential work carried out with no expense spared, P/x Warranty available**", "colour": null, "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": 1360, "unit": "kg", "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": null, "manufacturerEngineSize": null, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": null, "axleConfig": null, "ulezCompliant": false, "doors": 4, "bodyType": "Saloon", "cabType": "Unlisted", "rawBodyType": "Saloon", "fuel": "Petrol", "transmission": "Manual", "style": null, "subStyle": null, "make": "Mitsubishi", "model": "Lancer", "trim": "EVO VI GSR", "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": null, "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2025-12-05 12:40:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9977f38a50>

2025-12-05 12:40:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9977f392d0>

2.11.2

127.0.0.1:6029

2c5ece1f6d488436

2025-12-05 12:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']

2025-12-05 12:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>

2025-12-05 12:39:52 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 0 pages/min), scraped 19 items (at 0 items/min)

2025-12-05 12:34:52 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 12:34:52 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 12:34:52 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2025-12-05 12:34:52 [auto_selling_autotrader.co.uk] INFO: _job: 3087059ad1c111f0b120928152083da5, SCRAPY_JOB: None
2025-12-05 12:34:52 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 12:34:52 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 12:34:52 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 12:34:52 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 12:34:52 [scrapy.extensions.telnet] INFO: Telnet Password: 2c5ece1f6d488436
2025-12-05 12:34:52 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 12:34:52 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/3087059ad1c111f0b120928152083da5.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 12:34:52 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 12:34:52 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 12:34:52 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 12:34:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2025-12-05 12:34:52 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 12:34:52 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2025-12-05 12:34:52 [scrapy.core.engine] INFO: Spider opened
2025-12-05 12:34:52 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-05 12:34:52 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2025-12-05 12:34:52 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2025-12-05 12:34:52 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 12:34:52 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6029
2025-12-05 12:34:52 [scrapy-playwright] INFO: Starting download handler

2025-12-05 12:34:52 [scrapy-playwright] INFO: Starting download handler
2025-12-05 12:34:57 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10041004 and multipost_profile_id: 615d6f00-e0be-4c89-ad81-e104af761901 and job_id: 3087059ad1c111f0b120928152083da5 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=N70LU&retailerId=10041004&sort=price-asc
2025-12-05 12:34:57 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10041004, page: 1

2025-12-05 12:34:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 21
2025-12-05 12:35:10 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:35:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048352662%27 HTTP/1.1" 200 None
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048352662: 1
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512048352662, item: 202512048352662
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028297560%27 HTTP/1.1" 200 None
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028297560: 1
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512028297560, item: 202512028297560
2025-12-05 12:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268160243%27 HTTP/1.1" 200 None
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268160243: 1
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511268160243, item: 202511268160243
2025-12-05 12:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511218046844%27 HTTP/1.1" 200 None
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511218046844: 1
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511218046844, item: 202511218046844
2025-12-05 12:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511198007453%27 HTTP/1.1" 200 None
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511198007453: 1
2025-12-05 12:35:10 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511198007453, item: 202511198007453

            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210306,
             'Height': 1262,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/39c6bfe0e25843c6a6848359ef09e173.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242193,
             'Height': 1283,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/64c86e93030c4db0a0b091b082c3e07e.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234912,
             'Height': 1249,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/14502f82aeb142988b4c90024cba888d.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234490,
             'Height': 1301,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c4a928a386d4bd9a058386b779fe9d8.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281083,
             'Height': 1281,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5cc09c69a8934298b7e51b9e75b50a19.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284258,
             'Height': 1260,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b905a576f974856a6d5d91202f2783b.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187869,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7573d91c26c24c5cb025dbe989c440b9.jpg',
             'Width': 1404},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159960,
             'Height': 965,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f751bbb108d24fc0a12ee305f2593b88.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239181,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cbb7fe4365674a88a59c925daf7aa4b6.jpg',
             'Width': 1371},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268218,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e17e3b7d4bf40e283741c0f51b541fc.jpg',
             'Width': 1597},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170887,
             'Height': 990,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a9e358ba9d84789b3c13d1ab9975f5b.jpg',
             'Width': 1660},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183649,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ece3447693c64029bb222e3dc04229e6.jpg',
             'Width': 1299},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315789,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d44082fd280f4b2ebc6bc4828f25cdaf.jpg',
             'Width': 1245},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315061,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e622f8dadbf40d68868c0a9765f323b.jpg',
             'Width': 1245},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158997,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1d3ed0cb4cd46489484578a30652b21.jpg',
             'Width': 1245},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161575,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac3e7c6559d6478886c308c989f725f9.jpg',
             'Width': 1245},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214179,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e0d16fc85734ecdb2ccf471ed6f322a.jpg',
             'Width': 1245},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd87cbf-7ae9-50bc-a891-ad6560476075/8cd87cbf-7ae9-50bc-a891-ad6560476075_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144249,
             'Height': 1660,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/09d6ffe542a14657ac5b571e55a5a8d5.jpg',
             'Width': 1245}],
 'price': 8995,
 'price_includes_vat': True,
 'registration_date': '2013-01-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI S line Euro 5 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2013}
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511187978729%27 HTTP/1.1" 200 None
2025-12-05 12:40:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511187978729: {'created_time': 1764938445.549905, 'last_price_update_time': 1764938445.549914}
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511187978729') HTTP/1.1" 204 0
2025-12-05 12:40:45 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 12:40:45 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2025-12-05 12:40:45 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2025-12-05 12:40:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:40:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:40:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 3087059ad1c111f0b120928152083da5
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2025-12-05 12:40:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2025-12-05 12:40:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:40:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:40:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2025-12-05 12:40:45 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201763642445 HTTP/1.1" 200 None
2025-12-05 12:40:46 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (21 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/3087059ad1c111f0b120928152083da5.jl
2025-12-05 12:40:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 188479,
 'downloader/request_count': 41,
 'downloader/request_method_count/GET': 18,
 'downloader/request_method_count/POST': 23,
 'downloader/response_bytes': 6024805,
 'downloader/response_count': 41,
 'downloader/response_status_count/200': 41,
 'elapsed_time_seconds': 353.498945,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 12, 40, 45, 986775, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 21,
 'log_count/DEBUG': 1261,
 'log_count/ERROR': 4,
 'log_count/INFO': 771,
 'memusage/max': 159952896,
 'memusage/startup': 127053824,
 'photo_download_count': 18,
 'request_depth_max': 2,
 'response_received_count': 23,
 'scheduler/dequeued': 41,
 'scheduler/dequeued/memory': 41,
 'scheduler/enqueued': 41,
 'scheduler/enqueued/memory': 41,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 28,
 'scrapy-zyte-api/error_ratio': 0.17857142857142858,
 'scrapy-zyte-api/errors': 5,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 5,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 12.31010327893613,
 'scrapy-zyte-api/mean_response_seconds': 12.35653309555947,
 'scrapy-zyte-api/processed': 23,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 23,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 22,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 23,
 'scrapy-zyte-api/request_args/httpRequestBody': 23,
 'scrapy-zyte-api/request_args/httpRequestMethod': 23,
 'scrapy-zyte-api/request_args/httpResponseBody': 23,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 23,
 'scrapy-zyte-api/request_args/url': 23,
 'scrapy-zyte-api/status_codes/0': 5,
 'scrapy-zyte-api/status_codes/200': 23,
 'scrapy-zyte-api/success': 23,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 5, 12, 34, 52, 487830, tzinfo=datetime.timezone.utc)}
2025-12-05 12:40:46 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 12:40:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9977f38a50>
2025-12-05 12:40:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9977f392d0>

/1/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/3087059ad1c111f0b120928152083da5/?job_finished=True&ui=mobile

http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/3087059ad1c111f0b120928152083da5.log