2026-03-27 13:57:17 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_transmission: Unknown transmission type: unlisted
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 282, in _extract_transmission
    raise ValueError("Unknown transmission type: %s" % transmission)
ValueError: Unknown transmission type: unlisted

2026-03-27 13:57:17 [common.utils.decorators] ERROR: Payload: {"id": "202507294945560", "stockItemId": "8a42b09f98567e5c01985775029f18d9", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Volkswagen Golf 1.4 TSI BlueMotion Tech GT Estate 5dr Petrol DSG Euro 6 (s/s) (150 ps)", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock", "uvl"], "dueAtSeller": null, "motExpiry": "2026-08-01T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": true, "preReg": false, "heading": {"title": "Volkswagen Golf", "subtitle": "1.4 TSI BlueMotion Tech GT Estate 5dr Petrol DSG Euro 6 (s/s) (150 ps)", "__typename": "Heading"}, "attentionGrabber": "Great Car!", "rrp": null, "price": 9495, "priceGBX": 949500, "priceExcludingFees": 9495, "priceExcludingFeesGBX": 949500, "suppliedPrice": 9495, "suppliedPriceGBX": 949500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "INC_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2014-05-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 7912.5, "vatToBePaidUpfront": 1582.5, "capabilities": {"marketExtensionHomeDelivery": {"enabled": true, "__typename": "BooleanCapability"}, "marketExtensionClickAndCollect": {"enabled": true, "__typename": "MarketExtensionClickAndCollectCapability"}, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "W****NR", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10037616", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10037616", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 59, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418365081", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [{"name": "AA Dealer Promise", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaDealerPromise.jpg", "__typename": "Brand"}, {"name": "Zuto Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/zutoFinance.jpg", "__typename": "Brand"}, {"name": "Autoguard Warranties", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/autoGuardWarranties.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418365081", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.8", "__typename": "Reviews"}, "location": {"addressOne": "50A Sunderland Road", "addressTwo": null, "town": "Sandy", "county": "Bedfordshire", "postcode": "SG19 1QY", "latLong": "52.13271,-0.28309", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.taylorshillmotors.com", "__typename": "Link"}, "phoneNumber1": "(01462) 228947", "phoneNumber2": "(07822) 001692", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Taylors Hill Motors", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CLICKCOLLECT", "CODRIVER", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "HOMEDELIVERY", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "LOCPLUS", "LOCPLUS_ECONOMY", "LOCPLUS_WASV", "LOCPLUS_WASV", "PFIN", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home", "Arrange a time to suit you", "Ask our experts any questions"], "paragraphs": ["Do you think you live too far? We at Taylors Hill Motors would hate for you to travel hours and not be happy with the car. So we offer the most in depth video viewing possible. Ask our salesman show you anything, so that when you do make that long journey you know this is the car you want. "], "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 34, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/69a6f3a9e1dd4de98d69a22eabcb2312.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c69f0e779b55425bb5110439d5b5a6f4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f4ffdb2a42584e9c9d8a3661fb98a2cc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d79423e4f07c4322b84291cdb9c39abd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3ff108c219b4e0ab016a2e12a4a3899.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c40f9046938249d4ab765a2f0aeb9c08.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b2dff6f28cbb4f29a3e84e71ffee3d5b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ab137949cb754a7488f992af0e0faef7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3f1acf7ccca54d67b8e9cc3018724773.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1dd7024835d34eee9afb813ec8271e31.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8d923f8f3be545ccb9080183e3f74ae2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1cae477fce084849bd905ff85ef0404e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/afc9a5a4054942f3895523f2e0f938be.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7234f87fe6f149bc8ac07ebf333ee1c6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1c1d8d1bcc1044ecbb9db8f764b066bf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/77dbb9a9ac86488c8b0fa02ac286b385.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6649df7337a34d0c9c1759a643677444.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3a3a1d26cb2847c797b7a1c333c7be26.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/84ebabe18879498dbc2c42f71fa5eeb6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/391e445a4d8541a89e6368b994fe72d3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9cc7d97288df4db6bfd01c0699f49f96.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d4324adf03374662941e0f7c61cb9167.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6b72f7090a1c4f028cd2455bed1d2cb6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/149618b04b504aa7b06dc86cca8f73f3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6b51051e9bd74389b327d7a15e254802.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f0acff091d4a4deea08de0d255eb1285.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9d98ead000b64f8496086db438b388af.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8ee9d1e2c722420e8da5dfd46ed3bcc3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0971f997720e4b31a125b2020af2e053.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/808e5764bfcf4262bc65404d758974b7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fbfab517e47f4a6b9bc3385a264ce666.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/95532fbdebc543e6b3ae2295c0931da8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/14dc2dbc717545389daa0e5d29d272cb.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/670c3253b1be4f5d8648360183ca3acf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 45400, "unit": "MILE", "__typename": "Mileage"}, "plate": "25", "year": 2014, "vehicleCheckId": "2ce48b4d147644bb8e0945c53e8fd571", "vehicleCheckStatus": "FAILED", "vehicleCheckSummary": {"type": "FULL", "title": "Imported", "performed": "2025-08-09", "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": true, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "HIGH_RISK", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "MILEAGE_DISCREPANCY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "COLOUR_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "PRIVATE_FINANCE", "failed": false, "advisory": true, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "TRADE_FINANCE", "failed": true, "advisory": false, "critical": false, "warning": false, "__typename": "VehicleCheck"}, {"key": "REGISTRATION_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": true, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "Taylors Hill Motors", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CLICKCOLLECT", "CODRIVER", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "HOMEDELIVERY", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "LOCPLUS", "LOCPLUS_ECONOMY", "LOCPLUS_WASV", "PFIN", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "SANDY", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(01462) 228947", "phoneNumberTwo": "(07822) 001692", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "WE ARE PLEASED TO ANNOUNCE THAT TAYLORS HILL MOTORS HAS SUCCESSFULLY EXPANDED TO SANDY. ALL APPOINTMENTS WILL HAVE TO BE PRE-BOOKED SO THAT WE ARE ABLE TO PROVIDE CUSTOMERS WITH THE BEST EXPERIENCE WHEN IT GETS BUSY. PLEASE CALL AHEAD OR SEND US AN ENQUIRY ONLINE AND WE WILL BOOK YOU IN TO TEST DRIVE YOUR NEXT CAR. \r\nVISIT OUR WEBSITE FOR FULL SPECIFICATION, PICTURES AND OTHER CARS WE HAVE AVAILABLE**, Why buy from us? At Taylor's Hill Motors our aim is to provide a personal well-delivered service that enables us to stand out from our competitors. All our cars comes with 12 month free AA basic breakdown cover and must have minimum 6 month MOT. All of our cars go through a 45point health check to make sure that the car is in great condition.5 days drive away insurance available for any driver over 25.We have Auto Guard extended warranty options available that incorporates 6 months of safety and security for your car giving you a piece of mind guarantee that if the worst should happen then you are covered. We accept all major credit and debit cards for payment.\u00a3199 admin fees included in the price.\r\n**We recommend using AA Inspection but we also accept any inspection company to come view our cars and report back to you**", "colour": "Blue", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 0, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": {"co2Emission": 118, "unit": "g/km", "__typename": "Co2Emissions"}, "topSpeed": {"topSpeed": 135, "__typename": "Speed"}, "minimumKerbWeight": {"weight": 1368, "unit": "kg", "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": 1910, "unit": "kg", "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": 148, "unit": "BHP", "__typename": "Power"}, "sizeLitres": 1.4, "sizeCC": 1395, "manufacturerEngineSize": 1.4, "__typename": "Engine"}, "exteriorWidth": {"width": 2027, "unit": "mm", "__typename": "ExteriorWidth"}, "exteriorLength": {"length": 4562, "unit": "mm", "__typename": "ExteriorLength"}, "exteriorHeight": {"height": 1481, "unit": "mm", "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 5, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Estate", "cabType": "Unlisted", "rawBodyType": "Estate", "fuel": "Unlisted", "transmission": "Unlisted", "style": null, "subStyle": null, "make": "Volkswagen", "model": "Golf", "trim": "GT", "optionalFeatures": null, "standardFeatures": [{"description": "12V Socket - Luggage Compartment", "category": "Standard", "__typename": "Feature"}, {"description": "17in Alloy Wheels - Dijon", "category": "Standard", "__typename": "Feature"}, {"description": "ABS - Anti-lock Braking System with HBA - Hydraulic Brake Assist", "category": "Standard", "__typename": "Feature"}, {"description": "Adaptive Cruise Control", "category": "Standard", "__typename": "Feature"}, {"description": "Air Conditioning - Manual", "category": "Standard", "__typename": "Feature"}, {"description": "Airbags", "category": "Standard", "__typename": "Feature"}, {"description": "Alarm", "category": "Standard", "__typename": "Feature"}, {"description": "Ambient Lighting", "category": "Standard", "__typename": "Feature"}, {"description": "Automatic Post-Collision Braking System", "category": "Standard", "__typename": "Feature"}, {"description": "Bag Hooks in the Luggage Compartment", "category": "Standard", "__typename": "Feature"}, {"description": "Black Front Air Intake and Radiator Grille with Chrome Trimmed Inserts and Roundel Surround", "category": "Standard", "__typename": "Feature"}, {"description": "Body Coloured Bumpers", "category": "Standard", "__typename": "Feature"}, {"description": "Body Coloured Door Handles", "category": "Standard", "__typename": "Feature"}, {"description": "Body-Coloured Door Mirrors with Integrated Indicators", "category": "Standard", "__typename": "Feature"}, {"description": "Body-Coloured Roof Spoiler - Rear", "category": "Standard", "__typename": "Feature"}, {"description": "Brake Pad Wear Indicator", "category": "Standard", "__typename": "Feature"}, {"description": "Carpet Mats", "category": "Standard", "__typename": "Feature"}, {"description": "Cherry Red Rear Light Clusters", "category": "Standard", "__typename": "Feature"}, {"description": "Child Security Locks in the Rear Doors", "category": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Air Vent Surrounds", "category": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Electric Mirror Adjustment Switch Surround", "category": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Electric Window Button Surrounds", "category": "Standard", "__typename": "Feature"}, {"description": "Chrome Trimmed Front Air Intake Surround", "category": "Standard", "__typename": "Feature"}, {"description": "Chrome-Plated Light Switch Surround", "category": "Standard", "__typename": "Feature"}, {"description": "Composition Media System", "category": "Standard", "__typename": "Feature"}, {"description": "Convenience Pack", "category": "Standard", "__typename": "Feature"}, {"description": "Cover for Storage Compartment in Centre Console", "category": "Standard", "__typename": "Feature"}, {"description": "Cup Holders - Front x2", "category": "Standard", "__typename": "Feature"}, {"description": "Cyclone Decorative Inserts in Dash and Door Panels", "category": "Standard", "__typename": "Feature"}, {"description": "Discover Navigation Touch-Screen Navigation-Radio System with Car-Net Guide and Inform", "category": "Standard", "__typename": "Feature"}, {"description": "Driver Alert System", "category": "Standard", "__typename": "Feature"}, {"description": "Driver Profile Selection", "category": "Standard", "__typename": "Feature"}, {"description": "Drivers and Front Passengers Sun Visors with Vanity Mirrors", "category": "Standard", "__typename": "Feature"}, {"description": "Drivers and Passengers Safety Optimised Head Restraints", "category": "Standard", "__typename": "Feature"}, {"description": "Dust and Pollen Filter", "category": "Standard", "__typename": "Feature"}, {"description": "ESC - Electronic Stability Control including EDL - Electronic Differential Lock and ASR - Traction Control", "category": "Standard", "__typename": "Feature"}, {"description": "Electric Windows - Front and Rear", "category": "Standard", "__typename": "Feature"}, {"description": "Electronic Engine Immobiliser", "category": "Standard", "__typename": "Feature"}, {"description": "Electronic Parking Brake with Auto Hold Function", "category": "Standard", "__typename": "Feature"}, {"description": "Exhaust Tailpipes - Twin", "category": "Standard", "__typename": "Feature"}, {"description": "Extending Luggage Compartment Cover with Convenience Opening Stowable", "category": "Standard", "__typename": "Feature"}, {"description": "First-Aid Kit and Warning Triangle - Holder Only", "category": "Standard", "__typename": "Feature"}, {"description": "Footwell Illumination - Front", "category": "Standard", "__typename": "Feature"}, {"description": "Front Centre Armrest with Storage Compartment and Two Rear Air Vents", "category": "Standard", "__typename": "Feature"}, {"description": "Front Fog Lights", "category": "Standard", "__typename": "Feature"}, {"description": "Front Seat Back Storage Pockets", "category": "Standard", "__typename": "Feature"}, {"description": "Front Sport Seats with Height and Lumbar Adjustment", "category": "Standard", "__typename": "Feature"}, {"description": "Galvanised Body", "category": "Standard", "__typename": "Feature"}, {"description": "Gloss Black Decorative Inserts in Centre Console", "category": "Standard", "__typename": "Feature"}, {"description": "Glovebox - Illuminated and Cooled", "category": "Standard", "__typename": "Feature"}, {"description": "Grab Handles Front x2 Rear x2 with Integrated Coat Hooks", "category": "Standard", "__typename": "Feature"}, {"description": "Halogen Clear Headlights - Range Adjustable with Daytime Running Lights", "category": "Standard", "__typename": "Feature"}, {"description": "Heated Rear Windscreen", "category": "Standard", "__typename": "Feature"}, {"description": "Height and Reach Adjustable Steering Wheel", "category": "Standard", "__typename": "Feature"}, {"description": "Height-Adjustable Front Three-Point Seat Belts with Tensioners", "category": "Standard", "__typename": "Feature"}, {"description": "High Level 3rd Brake Light Incorporating LED Technology", "category": "Standard", "__typename": "Feature"}, {"description": "ISOFIX Child Seat Preparation for 2 Rear Seats", "category": "Standard", "__typename": "Feature"}, {"description": "Instrument Lighting - White Adjustable Panel Illumination", "category": "Standard", "__typename": "Feature"}, {"description": "Interior Light Delay", "category": "Standard", "__typename": "Feature"}, {"description": "Lights on Warning Buzzer", "category": "Standard", "__typename": "Feature"}, {"description": "Load Lashing Points x4 in Luggage Compartment", "category": "Standard", "__typename": "Feature"}, {"description": "Load-Through Provision", "category": "Standard", "__typename": "Feature"}, {"description": "Luggage Compartment Light", "category": "Standard", "__typename": "Feature"}, {"description": "Mirror Pack", "category": "Standard", "__typename": "Feature"}, {"description": "Parking Sensors - Front and Rear", "category": "Standard", "__typename": "Feature"}, {"description": "Power Assisted Steering - Speed-Sensitive - Electro-Mechanical Steering Rack", "category": "Standard", "__typename": "Feature"}, {"description": "Pre-Crash Preventive Occupant Protection", "category": "Standard", "__typename": "Feature"}, {"description": "Reading Lights - Front and Rear x2 Incorporating LED Technology", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Centre Armrest - Folding with Cup Holders x2", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Diffuser - Black", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Number Plate Lights Incorporating LED Technology", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Screen Wash-Wipe with Intermittent Wipe", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Tinted Glass - B Pillar Backwards - Approx 65 Percent Tinted", "category": "Standard", "__typename": "Feature"}, {"description": "Rear Window Aerial", "category": "Standard", "__typename": "Feature"}, {"description": "Reflectors in Doors", "category": "Standard", "__typename": "Feature"}, {"description": "Remote Central Locking with 2 Remote Folding Keys", "category": "Standard", "__typename": "Feature"}, {"description": "Roof Rails - Silver Anodised", "category": "Standard", "__typename": "Feature"}, {"description": "Seats - Split Folding Rear Backrests 60-40 - Folds Flat into Boot Floor", "category": "Standard", "__typename": "Feature"}, {"description": "Speedo and Rev Counter - Electronic Odometer - Trip - Service Interval Display - Exterior Temperature Gauge and Fuel Gauge", "category": "Standard", "__typename": "Feature"}, {"description": "Steel Space Saver Spare Wheel", "category": "Standard", "__typename": "Feature"}, {"description": "Steering Wheel - Multifunction - Leather Trimmed with Paddle Shift", "category": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Centre Console", "category": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Front Doors", "category": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Rear Doors", "category": "Standard", "__typename": "Feature"}, {"description": "Suspension - Sports - Lowered by Approx 15mm", "category": "Standard", "__typename": "Feature"}, {"description": "Three Rear 3-Point Seat Belts", "category": "Standard", "__typename": "Feature"}, {"description": "Three Rear Head Restraints", "category": "Standard", "__typename": "Feature"}, {"description": "Tyre Pressure Loss Indicator", "category": "Standard", "__typename": "Feature"}, {"description": "Under Seat Drawers - Front Passenger", "category": "Standard", "__typename": "Feature"}, {"description": "Vanity Mirrors - Illuminated", "category": "Standard", "__typename": "Feature"}, {"description": "Variable Boot Floor - Height Adjustable and Removable", "category": "Standard", "__typename": "Feature"}, {"description": "Warning Buzzer and Light for Front Seat Belts if Unfastened", "category": "Standard", "__typename": "Feature"}, {"description": "Windscreen Wipers with Intermittent Wipe and 4 Position Delay", "category": "Standard", "__typename": "Feature"}, {"description": "XDS Electronic Differential Lock for Improved Traction and Handling", "category": "Standard", "__typename": "Feature"}], "features": [{"category": "Exterior", "features": [{"description": "Blue exterior colour", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}, {"category": "Other", "features": [{"description": "12V Socket - Luggage Compartment", "type": "Standard", "__typename": "Feature"}, {"description": "17in Alloy Wheels - Dijon", "type": "Standard", "__typename": "Feature"}, {"description": "ABS - Anti-lock Braking System with HBA - Hydraulic Brake Assist", "type": "Standard", "__typename": "Feature"}, {"description": "Adaptive Cruise Control", "type": "Standard", "__typename": "Feature"}, {"description": "Air Conditioning - Manual", "type": "Standard", "__typename": "Feature"}, {"description": "Airbags", "type": "Standard", "__typename": "Feature"}, {"description": "Alarm", "type": "Standard", "__typename": "Feature"}, {"description": "Ambient Lighting", "type": "Standard", "__typename": "Feature"}, {"description": "Automatic Post-Collision Braking System", "type": "Standard", "__typename": "Feature"}, {"description": "Bag Hooks in the Luggage Compartment", "type": "Standard", "__typename": "Feature"}, {"description": "Black Front Air Intake and Radiator Grille with Chrome Trimmed Inserts and Roundel Surround", "type": "Standard", "__typename": "Feature"}, {"description": "Body Coloured Bumpers", "type": "Standard", "__typename": "Feature"}, {"description": "Body Coloured Door Handles", "type": "Standard", "__typename": "Feature"}, {"description": "Body-Coloured Door Mirrors with Integrated Indicators", "type": "Standard", "__typename": "Feature"}, {"description": "Body-Coloured Roof Spoiler - Rear", "type": "Standard", "__typename": "Feature"}, {"description": "Brake Pad Wear Indicator", "type": "Standard", "__typename": "Feature"}, {"description": "Carpet Mats", "type": "Standard", "__typename": "Feature"}, {"description": "Cherry Red Rear Light Clusters", "type": "Standard", "__typename": "Feature"}, {"description": "Child Security Locks in the Rear Doors", "type": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Air Vent Surrounds", "type": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Electric Mirror Adjustment Switch Surround", "type": "Standard", "__typename": "Feature"}, {"description": "Chrome Plated Electric Window Button Surrounds", "type": "Standard", "__typename": "Feature"}, {"description": "Chrome Trimmed Front Air Intake Surround", "type": "Standard", "__typename": "Feature"}, {"description": "Chrome-Plated Light Switch Surround", "type": "Standard", "__typename": "Feature"}, {"description": "Composition Media System", "type": "Standard", "__typename": "Feature"}, {"description": "Convenience Pack", "type": "Standard", "__typename": "Feature"}, {"description": "Cover for Storage Compartment in Centre Console", "type": "Standard", "__typename": "Feature"}, {"description": "Cup Holders - Front x2", "type": "Standard", "__typename": "Feature"}, {"description": "Cyclone Decorative Inserts in Dash and Door Panels", "type": "Standard", "__typename": "Feature"}, {"description": "Discover Navigation Touch-Screen Navigation-Radio System with Car-Net Guide and Inform", "type": "Standard", "__typename": "Feature"}, {"description": "Driver Alert System", "type": "Standard", "__typename": "Feature"}, {"description": "Driver Profile Selection", "type": "Standard", "__typename": "Feature"}, {"description": "Drivers and Front Passengers Sun Visors with Vanity Mirrors", "type": "Standard", "__typename": "Feature"}, {"description": "Drivers and Passengers Safety Optimised Head Restraints", "type": "Standard", "__typename": "Feature"}, {"description": "Dust and Pollen Filter", "type": "Standard", "__typename": "Feature"}, {"description": "ESC - Electronic Stability Control including EDL - Electronic Differential Lock and ASR - Traction Control", "type": "Standard", "__typename": "Feature"}, {"description": "Electric Windows - Front and Rear", "type": "Standard", "__typename": "Feature"}, {"description": "Electronic Engine Immobiliser", "type": "Standard", "__typename": "Feature"}, {"description": "Electronic Parking Brake with Auto Hold Function", "type": "Standard", "__typename": "Feature"}, {"description": "Exhaust Tailpipes - Twin", "type": "Standard", "__typename": "Feature"}, {"description": "Extending Luggage Compartment Cover with Convenience Opening Stowable", "type": "Standard", "__typename": "Feature"}, {"description": "First-Aid Kit and Warning Triangle - Holder Only", "type": "Standard", "__typename": "Feature"}, {"description": "Footwell Illumination - Front", "type": "Standard", "__typename": "Feature"}, {"description": "Front Centre Armrest with Storage Compartment and Two Rear Air Vents", "type": "Standard", "__typename": "Feature"}, {"description": "Front Fog Lights", "type": "Standard", "__typename": "Feature"}, {"description": "Front Seat Back Storage Pockets", "type": "Standard", "__typename": "Feature"}, {"description": "Front Sport Seats with Height and Lumbar Adjustment", "type": "Standard", "__typename": "Feature"}, {"description": "Galvanised Body", "type": "Standard", "__typename": "Feature"}, {"description": "Gloss Black Decorative Inserts in Centre Console", "type": "Standard", "__typename": "Feature"}, {"description": "Glovebox - Illuminated and Cooled", "type": "Standard", "__typename": "Feature"}, {"description": "Grab Handles Front x2 Rear x2 with Integrated Coat Hooks", "type": "Standard", "__typename": "Feature"}, {"description": "Halogen Clear Headlights - Range Adjustable with Daytime Running Lights", "type": "Standard", "__typename": "Feature"}, {"description": "Heated Rear Windscreen", "type": "Standard", "__typename": "Feature"}, {"description": "Height and Reach Adjustable Steering Wheel", "type": "Standard", "__typename": "Feature"}, {"description": "Height-Adjustable Front Three-Point Seat Belts with Tensioners", "type": "Standard", "__typename": "Feature"}, {"description": "High Level 3rd Brake Light Incorporating LED Technology", "type": "Standard", "__typename": "Feature"}, {"description": "ISOFIX Child Seat Preparation for 2 Rear Seats", "type": "Standard", "__typename": "Feature"}, {"description": "Instrument Lighting - White Adjustable Panel Illumination", "type": "Standard", "__typename": "Feature"}, {"description": "Interior Light Delay", "type": "Standard", "__typename": "Feature"}, {"description": "Lights on Warning Buzzer", "type": "Standard", "__typename": "Feature"}, {"description": "Load Lashing Points x4 in Luggage Compartment", "type": "Standard", "__typename": "Feature"}, {"description": "Load-Through Provision", "type": "Standard", "__typename": "Feature"}, {"description": "Luggage Compartment Light", "type": "Standard", "__typename": "Feature"}, {"description": "Mirror Pack", "type": "Standard", "__typename": "Feature"}, {"description": "Parking Sensors - Front and Rear", "type": "Standard", "__typename": "Feature"}, {"description": "Power Assisted Steering - Speed-Sensitive - Electro-Mechanical Steering Rack", "type": "Standard", "__typename": "Feature"}, {"description": "Pre-Crash Preventive Occupant Protection", "type": "Standard", "__typename": "Feature"}, {"description": "Reading Lights - Front and Rear x2 Incorporating LED Technology", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Centre Armrest - Folding with Cup Holders x2", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Diffuser - Black", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Number Plate Lights Incorporating LED Technology", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Screen Wash-Wipe with Intermittent Wipe", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Tinted Glass - B Pillar Backwards - Approx 65 Percent Tinted", "type": "Standard", "__typename": "Feature"}, {"description": "Rear Window Aerial", "type": "Standard", "__typename": "Feature"}, {"description": "Reflectors in Doors", "type": "Standard", "__typename": "Feature"}, {"description": "Remote Central Locking with 2 Remote Folding Keys", "type": "Standard", "__typename": "Feature"}, {"description": "Roof Rails - Silver Anodised", "type": "Standard", "__typename": "Feature"}, {"description": "Seats - Split Folding Rear Backrests 60-40 - Folds Flat into Boot Floor", "type": "Standard", "__typename": "Feature"}, {"description": "Speedo and Rev Counter - Electronic Odometer - Trip - Service Interval Display - Exterior Temperature Gauge and Fuel Gauge", "type": "Standard", "__typename": "Feature"}, {"description": "Steel Space Saver Spare Wheel", "type": "Standard", "__typename": "Feature"}, {"description": "Steering Wheel - Multifunction - Leather Trimmed with Paddle Shift", "type": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Centre Console", "type": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Front Doors", "type": "Standard", "__typename": "Feature"}, {"description": "Storage Compartment in Rear Doors", "type": "Standard", "__typename": "Feature"}, {"description": "Suspension - Sports - Lowered by Approx 15mm", "type": "Standard", "__typename": "Feature"}, {"description": "Three Rear 3-Point Seat Belts", "type": "Standard", "__typename": "Feature"}, {"description": "Three Rear Head Restraints", "type": "Standard", "__typename": "Feature"}, {"description": "Tyre Pressure Loss Indicator", "type": "Standard", "__typename": "Feature"}, {"description": "Under Seat Drawers - Front Passenger", "type": "Standard", "__typename": "Feature"}, {"description": "Vanity Mirrors - Illuminated", "type": "Standard", "__typename": "Feature"}, {"description": "Variable Boot Floor - Height Adjustable and Removable", "type": "Standard", "__typename": "Feature"}, {"description": "Warning Buzzer and Light for Front Seat Belts if Unfastened", "type": "Standard", "__typename": "Feature"}, {"description": "Windscreen Wipers with Intermittent Wipe and 4 Position Delay", "type": "Standard", "__typename": "Feature"}, {"description": "XDS Electronic Differential Lock for Improved Traction and Handling", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Front Wheel Drive", "torque": {"torque": 250, "unit": "Nm", "__typename": "Torque"}, "range": null, "interiorDescription": null, "exteriorDescription": "Blue exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-03-27 13:57:22 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fef6f55fb50>

2026-03-27 13:57:22 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fef6f5683d0>

2.11.2

127.0.0.1:6023

a24b3b76c6f107a3

2026-03-27 13:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/69a6f3a9e1dd4de98d69a22eabcb2312.jpg> (referer: https://www.autotrader.co.uk/)

2026-03-27 13:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/69a6f3a9e1dd4de98d69a22eabcb2312.jpg>

2026-03-27 13:56:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

2026-03-27 13:56:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 13:56:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 13:56:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-27 13:56:59 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-27 13:56:59 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-27 13:56:59 [auto_selling_autotrader.co.uk] INFO: _job: d166b71429e411f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-27 13:56:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 13:56:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 13:56:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 13:56:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 13:56:59 [scrapy.extensions.telnet] INFO: Telnet Password: a24b3b76c6f107a3
2026-03-27 13:56:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 13:56:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/d166b71429e411f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 13:56:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 13:56:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 13:56:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 13:56:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-27 13:56:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 13:56:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-27 13:56:59 [scrapy.core.engine] INFO: Spider opened
2026-03-27 13:56:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 13:56:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-27 13:56:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-27 13:56:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 13:56:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 13:56:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 13:56:59 [scrapy-playwright] INFO: Starting download handler

2026-03-27 13:56:59 [scrapy-playwright] INFO: Starting download handler
2026-03-27 13:57:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10037616 and multipost_profile_id: c0affd7e-48c5-4e56-bbdd-55f845f3a365 and job_id: d166b71429e411f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/taylors-hill-motors-10037616
2026-03-27 13:57:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10037616, page: 1
2026-03-27 13:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 60
2026-03-27 13:57:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 13:57:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271060654%27 HTTP/1.1" 200 None
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271060654: 1
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261045920%27 HTTP/1.1" 200 None
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261045920: 1
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261022260%27 HTTP/1.1" 200 None
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261022260: 1
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251008655%27 HTTP/1.1" 200 None
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603251008655: 1
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986334%27 HTTP/1.1" 200 None
2026-03-27 13:57:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250986334: 1
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603220904199%27 HTTP/1.1" 200 None

                'of mind. Every vehicle we sell comes with 12 months of free '
                'AA basic breakdown cover and a minimum 6-month MOT. Our cars '
                'undergo a comprehensive 45-point health check to ensure '
                'they’re in excellent condition. For added convenience, we '
                'offer 5-day drive-away insurance for drivers aged 25 and '
                'over.\r\n'
                '\r\n'
                'We also provide Auto Guard extended warranty options, '
                'offering 6 months of added security and peace of mind—so '
                'you’re covered in case the unexpected happens. Payment is '
                'simple with all major credit and debit cards accepted, and a '
                '£199 admin fee is included in the price.\r\n'
                '\r\n'
                'We highly recommend an AA inspection, but we’re happy to '
                'accommodate any inspection company of your choice to ensure '
                'you’re completely confident in your purchase.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '3e739b2e-a49a-55aa-b74d-60f8c82c4bd5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512068427517',
 'listing': 'directbuy',
 'location': 'Sandy, Bedfordshire',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 14500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e739b2e-a49a-55aa-b74d-60f8c82c4bd5/3e739b2e-a49a-55aa-b74d-60f8c82c4bd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358270,
             'Height': 1250,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ebc743ca4c044939f9357d66c17f814.jpg',
             'Width': 1660}],
 'price': 11995,
 'price_includes_vat': True,
 'registration_date': '2022-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Saint James Hatchback 5dr Petrol EAT6 Euro '
          '6 (s/s) (110 ps)',
 'transmission': 'automatic',
 'trim': 'Saint James',
 'year': 2022}
2026-03-27 13:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512068427517%27 HTTP/1.1" 200 None
2026-03-27 13:57:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512068427517: {'created_time': 1774619840.997817, 'last_price_update_time': 1774619840.997827}
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512068427517') HTTP/1.1" 204 0
2026-03-27 13:57:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d770d881-bfa1-580c-8d81-e3fda3b49cec with identifier 202507294945560
2026-03-27 13:57:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-27 13:57:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-27 13:57:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d770d881-bfa1-580c-8d81-e3fda3b49cec
2026-03-27 13:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/69a6f3a9e1dd4de98d69a22eabcb2312.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'WE ARE PLEASED TO ANNOUNCE THAT TAYLORS HILL MOTORS HAS '
                'SUCCESSFULLY EXPANDED TO SANDY. ALL APPOINTMENTS WILL HAVE TO '
                'BE PRE-BOOKED SO THAT WE ARE ABLE TO PROVIDE CUSTOMERS WITH '
                'THE BEST EXPERIENCE WHEN IT GETS BUSY. PLEASE CALL AHEAD OR '
                'SEND US AN ENQUIRY ONLINE AND WE WILL BOOK YOU IN TO TEST '
                'DRIVE YOUR NEXT CAR. \r\n'
                'VISIT OUR WEBSITE FOR FULL SPECIFICATION, PICTURES AND OTHER '
                "CARS WE HAVE AVAILABLE**, Why buy from us? At Taylor's Hill "
                'Motors our aim is to provide a personal well-delivered '
                'service that enables us to stand out from our competitors. '
                'All our cars comes with 12 month free AA basic breakdown '
                'cover and must have minimum 6 month MOT. All of our cars go '
                'through a 45point health check to make sure that the car is '
                'in great condition.5 days drive away insurance available for '
                'any driver over 25.We have Auto Guard extended warranty '
                'options available that incorporates 6 months of safety and '
                'security for your car giving you a piece of mind guarantee '
                'that if the worst should happen then you are covered. We '
                'accept all major credit and debit cards for payment.£199 '
                'admin fees included in the price.\r\n'
                '**We recommend using AA Inspection but we also accept any '
                'inspection company to come view our cars and report back to '
                'you**',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 148,
 'fuel_type': 'Unlisted',
 'id': 'd770d881-bfa1-580c-8d81-e3fda3b49cec',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507294945560',
 'listing': 'directbuy',
 'location': 'Sandy, Bedfordshire',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 45400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d770d881-bfa1-580c-8d81-e3fda3b49cec/d770d881-bfa1-580c-8d81-e3fda3b49cec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404228,
             'Height': 1250,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/69a6f3a9e1dd4de98d69a22eabcb2312.jpg',
             'Width': 1660}],
 'price': 9495,
 'price_includes_vat': True,
 'registration_date': '2014-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.4 TSI BlueMotion Tech GT Estate 5dr Petrol DSG '
          'Euro 6 (s/s) (150 ps)',
 'trim': 'GT',
 'year': 2014}
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507294945560%27 HTTP/1.1" 200 None
2026-03-27 13:57:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507294945560: {'created_time': 1774619841.050423, 'last_price_update_time': 1774619841.050436}
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507294945560') HTTP/1.1" 204 0
2026-03-27 13:57:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 13:57:21 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-27 13:57:21 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-27 13:57:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-27 13:57:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-27 13:57:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item d166b71429e411f18f76c264925fbcfa
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-27 13:57:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-27 13:57:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-27 13:57:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-27 13:57:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-27 13:57:21 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-27 13:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773323841 HTTP/1.1" 200 None
2026-03-27 13:57:22 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (60 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/d166b71429e411f18f76c264925fbcfa.jl
2026-03-27 13:57:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 481446,
 'downloader/request_count': 69,
 'downloader/request_method_count/GET': 60,
 'downloader/request_method_count/POST': 9,
 'downloader/response_bytes': 21760752,
 'downloader/response_count': 69,
 'downloader/response_status_count/200': 69,
 'elapsed_time_seconds': 22.363536,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 13, 57, 22, 165104, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 60,
 'log_count/DEBUG': 1066,
 'log_count/ERROR': 2,
 'log_count/INFO': 914,
 'memusage/max': 149303296,
 'memusage/startup': 149303296,
 'photo_download_count': 60,
 'request_depth_max': 4,
 'response_received_count': 9,
 'scheduler/dequeued': 69,
 'scheduler/dequeued/memory': 69,
 'scheduler/enqueued': 69,
 'scheduler/enqueued/memory': 69,
 'scrape_type/new': 60,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 9,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.8595517941543624,
 'scrapy-zyte-api/mean_response_seconds': 2.0985399912525384,
 'scrapy-zyte-api/processed': 9,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 9,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 8,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 9,
 'scrapy-zyte-api/request_args/httpRequestBody': 9,
 'scrapy-zyte-api/request_args/httpRequestMethod': 9,
 'scrapy-zyte-api/request_args/httpResponseBody': 9,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 9,
 'scrapy-zyte-api/request_args/url': 9,
 'scrapy-zyte-api/status_codes/200': 9,
 'scrapy-zyte-api/success': 9,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 27, 13, 56, 59, 801568, tzinfo=datetime.timezone.utc)}
2026-03-27 13:57:22 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 13:57:22 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fef6f55fb50>
2026-03-27 13:57:22 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fef6f5683d0>

/4/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/d166b71429e411f18f76c264925fbcfa/?job_finished=True

http://scrapyd-3:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/d166b71429e411f18f76c264925fbcfa.log