2025-12-05 12:17:14 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/auto_selling/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 655, in _parse_detail_response
    item = self.item_from_list_and_detail_merge(detail_item, list_item)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 675, in item_from_list_and_detail_merge
    item[field] = value
    ~~~~^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 119, in __setitem__
    raise ValueError(
ValueError: Field engine_horse_power must be one of (<class 'int'>,) types, received 88.7 (<class 'float'>)

2025-12-05 12:17:26 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/auto_selling/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 655, in _parse_detail_response
    item = self.item_from_list_and_detail_merge(detail_item, list_item)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 675, in item_from_list_and_detail_merge
    item[field] = value
    ~~~~^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 119, in __setitem__
    raise ValueError(
ValueError: Field engine_horse_power must be one of (<class 'int'>,) types, received 108.6 (<class 'float'>)

2025-12-05 12:17:35 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/auto_selling/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 655, in _parse_detail_response
    item = self.item_from_list_and_detail_merge(detail_item, list_item)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 675, in item_from_list_and_detail_merge
    item[field] = value
    ~~~~^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 119, in __setitem__
    raise ValueError(
ValueError: Field engine_horse_power must be one of (<class 'int'>,) types, received 128.2 (<class 'float'>)

2025-12-05 12:21:53 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/auto_selling/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 655, in _parse_detail_response
    item = self.item_from_list_and_detail_merge(detail_item, list_item)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto_selling_autotrader.py", line 675, in item_from_list_and_detail_merge
    item[field] = value
    ~~~~^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 119, in __setitem__
    raise ValueError(
ValueError: Field engine_horse_power must be one of (<class 'int'>,) types, received 123.4 (<class 'float'>)

2025-12-05 12:27:02 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None

2025-12-05 12:27:02 [common.utils.decorators] ERROR: Payload: {"id": "202511157916811", "stockItemId": "8a42b88a9a6daca1019a8814388a31db", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Voxy/Noah 1.8 VVT-h HYBRID 7 SEATS AUTO EURO 6 5dr", "excludePreviousOwners": true, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Voxy/noah", "subtitle": "1.8 VVT-h HYBRID 7 SEATS AUTO EURO 6 5dr", "__typename": "Heading"}, "attentionGrabber": "SAT NAV+7 SEATER+CAMERA+ULEZ", "rrp": null, "price": 10990, "priceGBX": 1099000, "priceExcludingFees": 10990, "priceExcludingFeesGBX": 1099000, "suppliedPrice": 10990, "suppliedPriceGBX": 1099000, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2016-12-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 10990, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "L****SL", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "1099", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "363923", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "363923", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 57, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418318653", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [{"name": "Carfinance247 finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/carFinance247.jpg", "__typename": "Brand"}, {"name": "Zuto Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/zutoFinance.jpg", "__typename": "Brand"}, {"name": "AA Dealer Promise", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaDealerPromise.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418318653", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"numberOfReviews": "400", "overallReviewRating": "4.9", "__typename": "Reviews"}, "location": {"addressOne": "Elstow Road", "addressTwo": null, "town": "Bedford", "county": "Bedfordshire", "postcode": "MK42 9LE", "latLong": "52.1275183,-0.4646249", "__typename": "Location"}, "marketing": {"profile": null, "strapline": "", "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.bedfordcarcentre.co.uk", "__typename": "Link"}, "phoneNumber1": "(01234) 677623", "phoneNumber2": "(07537) 124860", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Bedford Car Centres Limited", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home", "Arrange a time to suit you", "Ask our experts any questions"], "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 49, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/116c58c4a75c4254abbda598f750d397.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/de978f8a8a8a4d1499ddb0a81aa9e5c4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0ebe87ae071a4073a46a858873fa97dd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f2cd76471de14ec8a20d46370447f11c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d9f8377c78c549d483745e0b2cfe45fb.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/6f6f54aa022944d79c1ae0305eb555cc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/78637ff6e33545d9b3299b334f52b884.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1254b5f7954c45fa85d7654617bc5969.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ef3e4ccd50cc4be49320ba7dff158a22.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/60c06723ed384b768e3a8d6845901e6e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5bdf9d5ac9294f5186899b269d1d7956.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3073dcc346e04cf3b1f7186e8f7e5667.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d04ac3fac2c94e01b212380559340bc0.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/683b7573ccc046d0b445497c1c441f61.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/da08773cf5d845d087eaacde943d1567.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ab0a6cd557cd4dba9ee0905591a6c3d1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wing Mirror", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aaea1d4e1bea470dbdf7aeba54415a08.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/146ad8359a0a4a1489282831ffb2c994.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1928449374194f1ab4c10c71e343ab33.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/383c3d634598485b81705eea65e739a6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/43aaa3d5487e4d4e8175259749ca9710.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9da7a90b0def4f34983e582f8367c6ed.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d4e04e55ddaa4b428e4134ebaf2e03e3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/43ac0a1ea7f44478b95a5e22690f74ba.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/226b8164befe4b5a8d3efac195dc0d6a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e23c1633afc646098b2d9cf9cb918ef5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4f53ddd9ede749fa9bf973f53af64b26.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f4a5f7d74f4f46bc8f561a2009c90b8b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ad8062064cb840b1acb0f242273f8942.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d10d6aa7b95848baac6fa70ab2559679.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c9bf3b2721b94158b5cded83ce9b63fc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1b890b49adc14536b2ed9cb44ebd3e99.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4798b74fc8a48148300dd5fac6b833f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4a82a2a562b645fa88b053e4b2ef1a8f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/810a428444a5417c8781210eb1877ba3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5bd9cda11f83464faf74bf612b7c1a7d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d9bc8e0a74ae4351b341c9939a3e0e78.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9369d8f54cc94e32a04a26055ad334c2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/98b64365199f486a954f5e3f7243270a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0b0afd9a60224ca8be78c80cb7f209e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/83d3084900dd43b7a0cbe77bdbdb66ba.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cc167bf1ca3c40ada72e2d2f8ff265bb.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/32710883f45749dcb5ecc61e148bdbe9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/711673feff394972972890fbc3f6e70c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fb66211068284e9d9e2c3e345c28e4df.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/47ee107bf57c4f26848e67a39c71a747.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/af28b81f37fd4155b75f40ff9989d514.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/10d371b21398438ca2374393a8218b8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/315f3e7566e045309531b7e5fae664e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Driver Instruments", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 60000, "unit": "MILE", "__typename": "Mileage"}, "plate": "16", "year": 2016, "vehicleCheckId": "7ab568893fd24529a33334e9e5e910a6", "vehicleCheckStatus": "FAILED", "vehicleCheckSummary": {"type": "FULL", "title": "Imported", "performed": "2025-11-15", "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": true, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "HIGH_RISK", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "MILEAGE_DISCREPANCY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "COLOUR_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "PRIVATE_FINANCE", "failed": false, "advisory": true, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "TRADE_FINANCE", "failed": false, "advisory": false, "critical": false, "warning": false, "__typename": "VehicleCheck"}, {"key": "REGISTRATION_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": true, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "Bedford Car Centres Limited", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "BEDFORD", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(01234) 677623", "phoneNumberTwo": "(07537) 124860", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "++++DELIVERY ARRANGED+++++ULEZ COMPLIANT++++SERVICE HISTORY, 2 former keepers, IMPORTED FROM JAPAN IN 2019, UK REGISTERED+++++7 SEATER++++BLACK CLOTH INTERIOR, PRIVACY GLASS, Power steering, E/windows x4, R/c/locking, Electric folding mirrors, AIRCON/CLIMATE, Rear head restraints, SATELLITE NAVIGATION, REVERSE CAMERA, RADIO, BT AUDIO, APPS, USB, POWER MODE, EC MODE, EV MODE, REAR COOLER, AUTO DOORS, ANTI COLLISON ALERT, KEYLESS ENGINE START, MULTI FUNCTIONAL STEERING WHEEL, Auto headlights, Airbags, 15\" ALLOYS, colour coded, Mot November 2026, Looks and drives imamculate. 6 MONTHS NATIONWIDE WARRANTY, 12 MONTHS AA RECOVERY, FINANCE, DELIVERY, CARDS ACCEPTED, OPEN 7 DAYS", "colour": "Blue", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 3, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Right", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": {"co2Emission": 136, "unit": "g/km", "__typename": "Co2Emissions"}, "topSpeed": {"topSpeed": 0, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": 0, "bedrooms": 0, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 1.8, "sizeCC": 1798, "manufacturerEngineSize": 1.8, "__typename": "Engine"}, "exteriorWidth": {"width": 0, "unit": "mm", "__typename": "ExteriorWidth"}, "exteriorLength": {"length": 0, "unit": "mm", "__typename": "ExteriorLength"}, "exteriorHeight": {"height": 0, "unit": "mm", "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 7, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "MPV", "cabType": "Unlisted", "rawBodyType": "MPV", "fuel": "Petrol Hybrid", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Voxy", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Blue metallic exterior", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}

2025-12-05 12:29:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5834ca0d10>

2025-12-05 12:29:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5834ca1510>

2025-12-05 12:17:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://www.autotrader.co.uk/at-graphql> (failed 1 times): Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)]

2.11.2

127.0.0.1:6026

0f50e4c9c2bc8e04

2025-12-05 12:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']

2025-12-05 12:29:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>

2025-12-05 12:29:07 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 1 pages/min), scraped 156 items (at 1 items/min)

2025-12-05 11:57:07 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 11:57:07 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 11:57:07 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2025-12-05 11:57:07 [auto_selling_autotrader.co.uk] INFO: _job: 30103ad2d1c111f0b120928152083da5, SCRAPY_JOB: None
2025-12-05 11:57:07 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 11:57:07 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 11:57:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 11:57:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 11:57:07 [scrapy.extensions.telnet] INFO: Telnet Password: 0f50e4c9c2bc8e04
2025-12-05 11:57:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 11:57:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/30103ad2d1c111f0b120928152083da5.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 11:57:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 11:57:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 11:57:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 11:57:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2025-12-05 11:57:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 11:57:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2025-12-05 11:57:07 [scrapy.core.engine] INFO: Spider opened
2025-12-05 11:57:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 11:57:07 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2025-12-05 11:57:07 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2025-12-05 11:57:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 11:57:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2025-12-05 11:57:07 [scrapy-playwright] INFO: Starting download handler

2025-12-05 11:57:07 [scrapy-playwright] INFO: Starting download handler
2025-12-05 11:57:12 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 363923 and multipost_profile_id: 4b26ba9b-beba-4ff0-b6e9-30442beea6b5 and job_id: 30103ad2d1c111f0b120928152083da5 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=N70LU&retailerId=363923&sort=price-asc
2025-12-05 11:57:12 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 363923, page: 1

2025-12-05 11:57:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Page: 1/9, total results: 161
2025-12-05 11:57:29 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:57:29 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048366254%27 HTTP/1.1" 200 None
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048366254: 1
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512048366254, item: 202512048366254
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048352487%27 HTTP/1.1" 200 None
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048352487: 1
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512048352487, item: 202512048352487
2025-12-05 11:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511308242432%27 HTTP/1.1" 200 None
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511308242432: 1
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511308242432, item: 202511308242432
2025-12-05 11:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511308242333%27 HTTP/1.1" 200 None
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511308242333: 1
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511308242333, item: 202511308242333
2025-12-05 11:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511308241345%27 HTTP/1.1" 200 None
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511308241345: 1
2025-12-05 11:57:29 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511308241345, item: 202511308241345

             'FileSizeInBytes': 279503,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/94a67ff397df4afc812271df48fa6bd0.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346973,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d0cebae7a544d53995ba6d506ad0bc8.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244733,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e93d1aed0134af89900eaa6cc58fb22.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185023,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6cd16fdc21a54ce8a79966cab8ea8875.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250443,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/47f72ef99b1243d99790236f703d342b.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291655,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/787c1d5cd5a54fa9ad716c2baaed42e8.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267100,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1bf13c68e925423980853174cf284180.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279676,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2cda31d3b59a40278bc7e8da46b76c25.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197116,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2b886a6bdb64df1bdacab05fb05a013.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115792,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c2e3dd1be554b0cbe877cd9e685a51c.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133349,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee723dac9d4e4b5685d14645db14c085.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214320,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/73d6bb3634be473da25599019075d1a2.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193168,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0185b0991a7469f86d17fc38bdd75e7.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add24263-fd96-53d3-8b09-9ffba039519a/add24263-fd96-53d3-8b09-9ffba039519a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221904,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d052393500e430b967162639d39046d.jpg',
             'Width': 1280}],
 'price': 16490,
 'price_includes_vat': True,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI R-Line Hatchback 5dr Petrol Manual Euro 6 '
          '(s/s) (130 ps)',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2022}
2025-12-05 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268149400%27 HTTP/1.1" 200 None
2025-12-05 12:29:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268149400: {'created_time': 1764937779.265781, 'last_price_update_time': 1764937779.26579}
2025-12-05 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268149400') HTTP/1.1" 204 0
2025-12-05 12:29:39 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 12:29:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2025-12-05 12:29:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2025-12-05 12:29:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:29:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:29:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 30103ad2d1c111f0b120928152083da5
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2025-12-05 12:29:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2025-12-05 12:29:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:29:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:29:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2025-12-05 12:29:40 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202308201002617%27 HTTP/1.1" 200 None
2025-12-05 12:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202308201002617: {'created_time': 1764937780.62941}
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202308201002617') HTTP/1.1" 204 0
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202309152017356%27 HTTP/1.1" 200 None
2025-12-05 12:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202309152017356: {'created_time': 1764937780.671628}
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202309152017356') HTTP/1.1" 204 0
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202311023580410%27 HTTP/1.1" 200 None
2025-12-05 12:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202311023580410: {'created_time': 1764937780.706708}
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202311023580410') HTTP/1.1" 204 0
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202304236577391%27 HTTP/1.1" 200 None
2025-12-05 12:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202304236577391: {'created_time': 1764937780.759014}
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202304236577391') HTTP/1.1" 204 0
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201763641780 HTTP/1.1" 200 None
2025-12-05 12:29:40 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (157 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/30103ad2d1c111f0b120928152083da5.jl
2025-12-05 12:29:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 1,
 'downloader/exception_type_count/aiohttp.client_exceptions.ClientConnectorError': 1,
 'downloader/request_bytes': 1327418,
 'downloader/request_count': 191,
 'downloader/request_method_count/GET': 20,
 'downloader/request_method_count/POST': 171,
 'downloader/response_bytes': 13595610,
 'downloader/response_count': 190,
 'downloader/response_status_count/200': 190,
 'elapsed_time_seconds': 1953.164277,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 12, 29, 40, 846637, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 157,
 'log_count/DEBUG': 7875,
 'log_count/ERROR': 6,
 'log_count/INFO': 4186,
 'memusage/max': 159182848,
 'memusage/startup': 126476288,
 'photo_download_count': 20,
 'request_depth_max': 9,
 'response_received_count': 170,
 'retry/count': 1,
 'retry/reason_count/aiohttp.client_exceptions.ClientConnectorError': 1,
 'scheduler/dequeued': 191,
 'scheduler/dequeued/memory': 191,
 'scheduler/enqueued': 191,
 'scheduler/enqueued/memory': 191,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 222,
 'scrapy-zyte-api/error_ratio': 0.23423423423423423,
 'scrapy-zyte-api/errors': 52,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 52,
 'scrapy-zyte-api/fatal_errors': 1,
 'scrapy-zyte-api/mean_connection_seconds': 12.517017500034044,
 'scrapy-zyte-api/mean_response_seconds': 12.570925431173322,
 'scrapy-zyte-api/processed': 171,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 171,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 170,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 171,
 'scrapy-zyte-api/request_args/httpRequestBody': 171,
 'scrapy-zyte-api/request_args/httpRequestMethod': 171,
 'scrapy-zyte-api/request_args/httpResponseBody': 171,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 171,
 'scrapy-zyte-api/request_args/url': 171,
 'scrapy-zyte-api/status_codes/0': 52,
 'scrapy-zyte-api/status_codes/200': 170,
 'scrapy-zyte-api/success': 170,
 'scrapy-zyte-api/success_ratio': 0.9941520467836257,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/ValueError': 4,
 'start_time': datetime.datetime(2025, 12, 5, 11, 57, 7, 682360, tzinfo=datetime.timezone.utc)}
2025-12-05 12:29:40 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 12:29:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5834ca0d10>
2025-12-05 12:29:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5834ca1510>

/1/log/utf8/sourcing_v2/auto_selling_autotrader.co.uk/30103ad2d1c111f0b120928152083da5/?job_finished=True

http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_autotrader.co.uk/30103ad2d1c111f0b120928152083da5.log