2026-01-28 12:38:20 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_transmission: Unknown transmission type: unlisted
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 282, in _extract_transmission
    raise ValueError("Unknown transmission type: %s" % transmission)
ValueError: Unknown transmission type: unlisted

2026-01-28 12:38:20 [common.utils.decorators] ERROR: Payload: {"id": "202512298828639", "stockItemId": "8a42cf8c9b4b0572019b6a9d943d6ed6", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Ford Mustang 4.7", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Ford Mustang", "subtitle": "4.7", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 69995, "priceGBX": 6999500, "priceExcludingFees": 69995, "priceExcludingFeesGBX": 6999500, "suppliedPrice": 69995, "suppliedPriceGBX": 6999500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "1967-03-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 69995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "W****5S", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "7000", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10039415", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10039415", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 47, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418374290", "__typename": "AssignedNumber"}, "atAwards": [{"year": "2024", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "Warranty Solutions Group", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantySolutionsGroup.jpg", "__typename": "Brand"}, {"name": "SAF - Specialist Automotive Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/specialistAutomotive.jpg", "__typename": "Brand"}, {"name": "AA Inspections", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaInspections.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418374290", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "unit 3b milton business park Gayton Road", "addressTwo": "Milton Malsor", "town": "Northampton", "county": "Northamptonshire", "postcode": "NN7 3AB", "latLong": "52.194601,-0.9402434", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.hamptoncarsales.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07441) 900485", "phoneNumber2": "(01604) 318466", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "HAMPTON CAR SALES LTD", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": null, "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 3, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/a517a4782833487380ae349f3e3c207d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/844d9586fd2c45c7b3c55bdc3fd3220c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/33323aef909145049030467575da8f48.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 1700, "unit": "MILE", "__typename": "Mileage"}, "plate": "W", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "HAMPTON CAR SALES LTD", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "NORTHAMPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07441) 900485", "phoneNumberTwo": "(01604) 318466", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Welcome to the sale of my much loved 1967 Ford Mustang Fastback. The car is in very original condition with matching numbers on the door jam and inner wing/fender, as well as most of the original glass.\n\nI imported the car in 2021 from Georgia and I am the only UK owner. It has just been under an extensive restoration in the last few months. The car was stripped back down to bare metal, all filler removed and fabricated sheet metal welded in where required. As a result, it\u2019s now a rust and filler-free example. The car has not been driven since its fresh coat of paint (trailered to Hamptons) so the new owner will get the joys of the first drive since the restoration! The transmission was also serviced during this time.\n\nOut of the factory, it was a 3-speed manual transmission and painted in \u2018Dark Moss\u2019 green, as per Marti Report.\n\nThe car has:\n\n- Original 289 small block engine which has just had an oil change, runs smoothly.\n- 8\u201d differential with brand new Hauser Racing half shafts (new diff gasket has just been fit).\n- Uprated Flex-a-lite electric cooling fan.\n- Flowmaster exhausts.\n- 5-speed manual Tremec transmission.\n- Dakota gauges.\n- Brake disc conversion.\n- Really solid chassis (N.B. I imported the car from Georgia in 2021).\n- Aftermarket fibreglass bonnet/hood.\n- In my care, I have fit a new ignition switch, flushed the radiator, replaced the rear half shafts, flushed the diff, replaced the door locks and fit wing mirrors.\n- Brand new front suspension has just been fit too by the garage.\n\nThese cars are getting harder and harder to come by in the UK, especially manual ones which need no further restoration. It\u2019s ready to either be a garage queen or a fun driver! I\u2019ve done 1,700 trouble-free miles since I took ownership and it never fails to bring a smile to your face.\n\nPhotos of the restoration will be made available to the new owner.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": null, "topSpeed": {"topSpeed": 0, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": 0, "bedrooms": 0, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 4.7, "sizeCC": 4727, "manufacturerEngineSize": 4.7, "__typename": "Engine"}, "exteriorWidth": {"width": 0, "unit": "mm", "__typename": "ExteriorWidth"}, "exteriorLength": {"length": 0, "unit": "mm", "__typename": "ExteriorLength"}, "exteriorHeight": {"height": 0, "unit": "mm", "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 4, "axleConfig": null, "ulezCompliant": true, "doors": null, "bodyType": "Convertible", "cabType": "Unlisted", "rawBodyType": "Convertible", "fuel": "Petrol", "transmission": "Unlisted", "style": null, "subStyle": null, "make": "Ford", "model": "Mustang", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 360, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Rear Wheel Drive", "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-01-28 12:38:20 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None

2026-01-28 12:38:20 [common.utils.decorators] ERROR: Payload: {"id": "202512298828639", "stockItemId": "8a42cf8c9b4b0572019b6a9d943d6ed6", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Ford Mustang 4.7", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Ford Mustang", "subtitle": "4.7", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 69995, "priceGBX": 6999500, "priceExcludingFees": 69995, "priceExcludingFeesGBX": 6999500, "suppliedPrice": 69995, "suppliedPriceGBX": 6999500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "1967-03-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 69995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "W****5S", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "7000", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10039415", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10039415", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 47, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418374290", "__typename": "AssignedNumber"}, "atAwards": [{"year": "2024", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "Warranty Solutions Group", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantySolutionsGroup.jpg", "__typename": "Brand"}, {"name": "SAF - Specialist Automotive Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/specialistAutomotive.jpg", "__typename": "Brand"}, {"name": "AA Inspections", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaInspections.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418374290", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "unit 3b milton business park Gayton Road", "addressTwo": "Milton Malsor", "town": "Northampton", "county": "Northamptonshire", "postcode": "NN7 3AB", "latLong": "52.194601,-0.9402434", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.hamptoncarsales.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07441) 900485", "phoneNumber2": "(01604) 318466", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "HAMPTON CAR SALES LTD", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": null, "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 3, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/a517a4782833487380ae349f3e3c207d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/844d9586fd2c45c7b3c55bdc3fd3220c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/33323aef909145049030467575da8f48.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 1700, "unit": "MILE", "__typename": "Mileage"}, "plate": "W", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "HAMPTON CAR SALES LTD", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "NORTHAMPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07441) 900485", "phoneNumberTwo": "(01604) 318466", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Welcome to the sale of my much loved 1967 Ford Mustang Fastback. The car is in very original condition with matching numbers on the door jam and inner wing/fender, as well as most of the original glass.\n\nI imported the car in 2021 from Georgia and I am the only UK owner. It has just been under an extensive restoration in the last few months. The car was stripped back down to bare metal, all filler removed and fabricated sheet metal welded in where required. As a result, it\u2019s now a rust and filler-free example. The car has not been driven since its fresh coat of paint (trailered to Hamptons) so the new owner will get the joys of the first drive since the restoration! The transmission was also serviced during this time.\n\nOut of the factory, it was a 3-speed manual transmission and painted in \u2018Dark Moss\u2019 green, as per Marti Report.\n\nThe car has:\n\n- Original 289 small block engine which has just had an oil change, runs smoothly.\n- 8\u201d differential with brand new Hauser Racing half shafts (new diff gasket has just been fit).\n- Uprated Flex-a-lite electric cooling fan.\n- Flowmaster exhausts.\n- 5-speed manual Tremec transmission.\n- Dakota gauges.\n- Brake disc conversion.\n- Really solid chassis (N.B. I imported the car from Georgia in 2021).\n- Aftermarket fibreglass bonnet/hood.\n- In my care, I have fit a new ignition switch, flushed the radiator, replaced the rear half shafts, flushed the diff, replaced the door locks and fit wing mirrors.\n- Brand new front suspension has just been fit too by the garage.\n\nThese cars are getting harder and harder to come by in the UK, especially manual ones which need no further restoration. It\u2019s ready to either be a garage queen or a fun driver! I\u2019ve done 1,700 trouble-free miles since I took ownership and it never fails to bring a smile to your face.\n\nPhotos of the restoration will be made available to the new owner.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": null, "topSpeed": {"topSpeed": 0, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": 0, "bedrooms": 0, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 4.7, "sizeCC": 4727, "manufacturerEngineSize": 4.7, "__typename": "Engine"}, "exteriorWidth": {"width": 0, "unit": "mm", "__typename": "ExteriorWidth"}, "exteriorLength": {"length": 0, "unit": "mm", "__typename": "ExteriorLength"}, "exteriorHeight": {"height": 0, "unit": "mm", "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 4, "axleConfig": null, "ulezCompliant": true, "doors": null, "bodyType": "Convertible", "cabType": "Unlisted", "rawBodyType": "Convertible", "fuel": "Petrol", "transmission": "Unlisted", "style": null, "subStyle": null, "make": "Ford", "model": "Mustang", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 360, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Rear Wheel Drive", "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-01-28 12:38:20 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable

2026-01-28 12:38:20 [common.utils.decorators] ERROR: Payload: {"id": "202512298828639", "stockItemId": "8a42cf8c9b4b0572019b6a9d943d6ed6", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Ford Mustang 4.7", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Ford Mustang", "subtitle": "4.7", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 69995, "priceGBX": 6999500, "priceExcludingFees": 69995, "priceExcludingFeesGBX": 6999500, "suppliedPrice": 69995, "suppliedPriceGBX": 6999500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "1967-03-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 69995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "W****5S", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "7000", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10039415", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10039415", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 47, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418374290", "__typename": "AssignedNumber"}, "atAwards": [{"year": "2024", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "Warranty Solutions Group", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantySolutionsGroup.jpg", "__typename": "Brand"}, {"name": "SAF - Specialist Automotive Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/specialistAutomotive.jpg", "__typename": "Brand"}, {"name": "AA Inspections", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaInspections.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418374290", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "unit 3b milton business park Gayton Road", "addressTwo": "Milton Malsor", "town": "Northampton", "county": "Northamptonshire", "postcode": "NN7 3AB", "latLong": "52.194601,-0.9402434", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.hamptoncarsales.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07441) 900485", "phoneNumber2": "(01604) 318466", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "HAMPTON CAR SALES LTD", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": null, "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 3, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/a517a4782833487380ae349f3e3c207d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/844d9586fd2c45c7b3c55bdc3fd3220c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/33323aef909145049030467575da8f48.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 1700, "unit": "MILE", "__typename": "Mileage"}, "plate": "W", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "HAMPTON CAR SALES LTD", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "NORTHAMPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07441) 900485", "phoneNumberTwo": "(01604) 318466", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Welcome to the sale of my much loved 1967 Ford Mustang Fastback. The car is in very original condition with matching numbers on the door jam and inner wing/fender, as well as most of the original glass.\n\nI imported the car in 2021 from Georgia and I am the only UK owner. It has just been under an extensive restoration in the last few months. The car was stripped back down to bare metal, all filler removed and fabricated sheet metal welded in where required. As a result, it\u2019s now a rust and filler-free example. The car has not been driven since its fresh coat of paint (trailered to Hamptons) so the new owner will get the joys of the first drive since the restoration! The transmission was also serviced during this time.\n\nOut of the factory, it was a 3-speed manual transmission and painted in \u2018Dark Moss\u2019 green, as per Marti Report.\n\nThe car has:\n\n- Original 289 small block engine which has just had an oil change, runs smoothly.\n- 8\u201d differential with brand new Hauser Racing half shafts (new diff gasket has just been fit).\n- Uprated Flex-a-lite electric cooling fan.\n- Flowmaster exhausts.\n- 5-speed manual Tremec transmission.\n- Dakota gauges.\n- Brake disc conversion.\n- Really solid chassis (N.B. I imported the car from Georgia in 2021).\n- Aftermarket fibreglass bonnet/hood.\n- In my care, I have fit a new ignition switch, flushed the radiator, replaced the rear half shafts, flushed the diff, replaced the door locks and fit wing mirrors.\n- Brand new front suspension has just been fit too by the garage.\n\nThese cars are getting harder and harder to come by in the UK, especially manual ones which need no further restoration. It\u2019s ready to either be a garage queen or a fun driver! I\u2019ve done 1,700 trouble-free miles since I took ownership and it never fails to bring a smile to your face.\n\nPhotos of the restoration will be made available to the new owner.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": null, "topSpeed": {"topSpeed": 0, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": 0, "bedrooms": 0, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 4.7, "sizeCC": 4727, "manufacturerEngineSize": 4.7, "__typename": "Engine"}, "exteriorWidth": {"width": 0, "unit": "mm", "__typename": "ExteriorWidth"}, "exteriorLength": {"length": 0, "unit": "mm", "__typename": "ExteriorLength"}, "exteriorHeight": {"height": 0, "unit": "mm", "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 4, "axleConfig": null, "ulezCompliant": true, "doors": null, "bodyType": "Convertible", "cabType": "Unlisted", "rawBodyType": "Convertible", "fuel": "Petrol", "transmission": "Unlisted", "style": null, "subStyle": null, "make": "Ford", "model": "Mustang", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 360, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Rear Wheel Drive", "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2026-01-28 12:45:52 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f17375353d0>

2026-01-28 12:45:52 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f1737535c10>

2.11.2

127.0.0.1:6028

89a31066b2786198

2026-01-28 12:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']

2026-01-28 12:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>

2026-01-28 12:44:59 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 0 pages/min), scraped 62 items (at 0 items/min)

2026-01-28 12:34:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 12:34:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 12:34:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-01-28 12:34:59 [auto_selling_autotrader.co.uk] INFO: _job: 255f3c5cfc3011f0a599c2c555c92d63, SCRAPY_JOB: None
2026-01-28 12:34:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 12:34:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 12:34:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 12:34:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 12:34:59 [scrapy.extensions.telnet] INFO: Telnet Password: 89a31066b2786198
2026-01-28 12:34:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 12:34:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/255f3c5cfc3011f0a599c2c555c92d63.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 12:34:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 12:34:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 12:34:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 12:34:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-01-28 12:34:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 12:34:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-01-28 12:34:59 [scrapy.core.engine] INFO: Spider opened
2026-01-28 12:34:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 12:34:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-01-28 12:34:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-01-28 12:34:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 12:34:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6028
2026-01-28 12:34:59 [scrapy-playwright] INFO: Starting download handler

2026-01-28 12:34:59 [scrapy-playwright] INFO: Starting download handler
2026-01-28 12:35:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10039415 and multipost_profile_id: 324ec4b3-ca3e-4d7b-bada-bfab8780f422 and job_id: 255f3c5cfc3011f0a599c2c555c92d63 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10039415&sort=price-asc
2026-01-28 12:35:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10039415, page: 1
2026-01-28 12:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 12:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Page: 1/4, total results: 63
2026-01-28 12:35:08 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 12:35:08 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279469504%27 HTTP/1.1" 200 None
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601279469504: 1
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202601279469504, item: 202601279469504
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249399785%27 HTTP/1.1" 200 None
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601249399785: 1
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202601249399785, item: 202601249399785
2026-01-28 12:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249399684%27 HTTP/1.1" 200 None
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601249399684: 1
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202601249399684, item: 202601249399684
2026-01-28 12:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249398439%27 HTTP/1.1" 200 None
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601249398439: 1
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202601249398439, item: 202601249398439
2026-01-28 12:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239375175%27 HTTP/1.1" 200 None
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239375175: 1
2026-01-28 12:35:08 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202601239375175, item: 202601239375175

             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/65327ad9ebea4f58ba0037d4e94fa24f.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153730,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab873011fc7d4ea8a213c5977b0900ad.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235973,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/520250804c2246f18e31f399a6632663.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209906,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4044289eeaa04824acc6c8c312744c68.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205160,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea2ecba51f5043d6a731d672bfb613d6.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186083,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ccb5cd4cbd3a42c0aec50966a5158c34.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251726,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/803288ddb7014d74a00faa19d2396475.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118448,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f70646acfb3540c895fb25df2059ea3c.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139399,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4722fd92cc54b6cb1508716d44051cb.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152299,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/62a7703b05874fb68c3d154dec90271f.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114943,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5823b83e1f1d49c6b88543ccbbfd6c9d.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95940,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/69e43b3766ac4a768eaf141c771a917d.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58609,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0223e2d997e8484c99ddd23dea41bf90.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99532,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fed78658574040d3940b8ad1f3b70ec7.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94161,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0cab5d5ff54472f999e2b31b9bc149a.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82440,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab136b8b35d84de39199f55934601344.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107424,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/19759f1b283e4e2f9aedd9b40b9bb71d.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2840de1f-84b2-5844-bf53-fe05c47b1042/2840de1f-84b2-5844-bf53-fe05c47b1042_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124802,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea2479a3529d41eeb6ec626ba38ab8e0.jpg',
             'Width': 1280}],
 'price': 6995,
 'price_includes_vat': True,
 'registration_date': '2015-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES 3.0 530d Luxury Saloon 4dr Diesel Auto Euro 6 (s/s) '
          '(258 ps)',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2015}
2026-01-28 12:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229332702%27 HTTP/1.1" 200 None
2026-01-28 12:45:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229332702: {'created_time': 1769604350.896859, 'last_price_update_time': 1769604350.896871}
2026-01-28 12:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229332702') HTTP/1.1" 204 0
2026-01-28 12:45:50 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 12:45:50 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-01-28 12:45:50 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-01-28 12:45:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-01-28 12:45:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-01-28 12:45:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 255f3c5cfc3011f0a599c2c555c92d63
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-01-28 12:45:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-01-28 12:45:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 12:45:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-01-28 12:45:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-01-28 12:45:51 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 3, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-28 12:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 12:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201768308351 HTTP/1.1" 200 None
2026-01-28 12:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099027463') HTTP/1.1" 204 0
2026-01-28 12:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601129095301') HTTP/1.1" 204 0
2026-01-28 12:45:52 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (63 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/255f3c5cfc3011f0a599c2c555c92d63.jl
2026-01-28 12:45:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 525301,
 'downloader/request_count': 87,
 'downloader/request_method_count/GET': 20,
 'downloader/request_method_count/POST': 67,
 'downloader/response_bytes': 7047039,
 'downloader/response_count': 87,
 'downloader/response_status_count/200': 87,
 'elapsed_time_seconds': 652.495616,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 12, 45, 51, 943740, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 63,
 'log_count/DEBUG': 3432,
 'log_count/ERROR': 6,
 'log_count/INFO': 1908,
 'memusage/max': 162926592,
 'memusage/startup': 126324736,
 'photo_download_count': 20,
 'request_depth_max': 4,
 'response_received_count': 67,
 'scheduler/dequeued': 87,
 'scheduler/dequeued/memory': 87,
 'scheduler/enqueued': 87,
 'scheduler/enqueued/memory': 87,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 75,
 'scrapy-zyte-api/error_ratio': 0.10666666666666667,
 'scrapy-zyte-api/errors': 8,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 8,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 13.226630160154137,
 'scrapy-zyte-api/mean_response_seconds': 13.304096336434808,
 'scrapy-zyte-api/processed': 67,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 67,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 66,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 67,
 'scrapy-zyte-api/request_args/httpRequestBody': 67,
 'scrapy-zyte-api/request_args/httpRequestMethod': 67,
 'scrapy-zyte-api/request_args/httpResponseBody': 67,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 67,
 'scrapy-zyte-api/request_args/url': 67,
 'scrapy-zyte-api/status_codes/0': 8,
 'scrapy-zyte-api/status_codes/200': 67,
 'scrapy-zyte-api/success': 67,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 12, 34, 59, 448124, tzinfo=datetime.timezone.utc)}
2026-01-28 12:45:52 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-28 12:45:52 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f17375353d0>
2026-01-28 12:45:52 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f1737535c10>

/1/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/255f3c5cfc3011f0a599c2c555c92d63/?job_finished=True&ui=mobile

http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/255f3c5cfc3011f0a599c2c555c92d63.log