2026-03-27 14:35:18 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:18 [scrapy.core.scraper] ERROR: Spider error processing <GET https://auction.sytner.co.uk/Listing/Detail/562181> (referer: https://auction.sytner.co.uk/Listing/Search?Type=Basic&Manufacturers=Manufacturer+%28Any%29&Min_Category_PriceID=0&Max_Category_PriceID=999999999)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:33 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:34 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field make is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:35:34 [scrapy.core.scraper] ERROR: Spider error processing <GET https://auction.sytner.co.uk/Listing/Detail/562174> (referer: https://auction.sytner.co.uk/Listing/Search?Type=Basic&Manufacturers=Manufacturer+%28Any%29&Min_Category_PriceID=0&Max_Category_PriceID=999999999)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable

2026-03-27 14:33:44 [crawlers.middlewares.photo_download_middleware] WARNING: Non-image content-type 'text/html' for image 9 of item cb2be01e-1351-5343-a919-3a6012fc9ab8

2026-03-27 14:33:45 [crawlers.middlewares.photo_download_middleware] WARNING: Non-image content-type 'text/html' for image 7 of item cb2be01e-1351-5343-a919-3a6012fc9ab8

2026-03-27 14:33:45 [crawlers.middlewares.photo_download_middleware] WARNING: Non-image content-type 'text/html' for image 6 of item cb2be01e-1351-5343-a919-3a6012fc9ab8

2026-03-27 14:33:45 [crawlers.middlewares.photo_download_middleware] WARNING: Non-image content-type 'text/html' for image 5 of item cb2be01e-1351-5343-a919-3a6012fc9ab8

2026-03-27 14:33:56 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562181> would get 140 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2026-03-27 14:33:59 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562179> would get 141 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2026-03-27 14:34:09 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562178> would get 141 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2026-03-27 14:34:17 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562177> would get 142 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2026-03-27 14:34:25 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562176> would get 143 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2026-03-27 14:34:44 [scrapy_zyte_api._params] WARNING: Request <GET https://auction.sytner.co.uk/Listing/Detail/562174> would get 143 cookies, but request cookie automatic mapping is limited to 100 cookies (see the ZYTE_API_MAX_COOKIES setting), so only 100 cookies have been added to this request. To silence this warning, set the request cookies manually through the experimental.requestCookies Zyte API parameter instead. Alternatively, if Zyte API starts supporting more than 100 request cookies, update the ZYTE_API_MAX_COOKIES setting accordingly.

2.11.2

127.0.0.1:6023

6c712c388e063eb5

2026-03-27 14:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://auction.sytner.co.uk/Listing/Detail/562174> (referer: https://auction.sytner.co.uk/Listing/Search?Type=Basic&Manufacturers=Manufacturer+%28Any%29&Min_Category_PriceID=0&Max_Category_PriceID=999999999) ['zyte-api']

2026-03-27 14:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://auction.sytner.co.uk/Listing/Detail/562171>

2026-03-27 14:35:05 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 6 pages/min), scraped 16 items (at 1 items/min)

2026-03-27 14:30:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 14:30:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 14:30:04 [sytner.gb] INFO: Starting spider sytner.gb
2026-03-27 14:30:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 14:30:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 14:30:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 14:30:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 14:30:04 [scrapy.extensions.telnet] INFO: Telnet Password: 6c712c388e063eb5
2026-03-27 14:30:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 14:30:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/sytner.gb/task_11_2026-03-27T14_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 14:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 14:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 14:30:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 14:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 14:30:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 14:30:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 14:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 14:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 14:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 14:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 14:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 14:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 14:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 14:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 14:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 14:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 14:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-27 14:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 14:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 14:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 14:30:05 [scrapy-playwright] INFO: Starting download handler

2026-03-27 14:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-27 14:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 14:30:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 14:30:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)

    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/sytner.py", line 151, in parse_listing_detail
    item["make"] = self._extract_make(specs)
    ~~~~^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field make is not nullable
2026-03-27 14:35:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 14:35:34 [sytner.gb] INFO: sytner.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562182%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562182: {'created_time': 1774622134.467612}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562182') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562174%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562174: {'created_time': 1774622134.509352}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562174') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562179%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562179: {'created_time': 1774622134.564833}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562179') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562178%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562178: {'created_time': 1774622134.599782}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562178') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562157%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562157: {'created_time': 1774622134.665655}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562157') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562176%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562176: {'created_time': 1774622134.717298}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562176') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562166%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562166: {'created_time': 1774622134.75686}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562166') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562184%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562184: {'created_time': 1774622134.790302}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562184') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562181%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562181: {'created_time': 1774622134.822004}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562181') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562186%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562186: {'created_time': 1774622134.865439}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562186') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562177%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562177: {'created_time': 1774622134.904585}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562177') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20RowKey%20eq%20%27562183%27 HTTP/1.1" 200 None
2026-03-27 14:35:34 [sytner.gb] INFO: Saving data for 562183: {'created_time': 1774622134.949811}
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='sytner.gb',RowKey='562183') HTTP/1.1" 204 0
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 14:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27sytner.gb%27%20and%20last_price_update_time%20lt%201774190134 HTTP/1.1" 200 None
2026-03-27 14:35:35 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (17 items) in: file:///var/lib/scrapyd/items/sourcing_v2/sytner.gb/task_11_2026-03-27T14_30_00.jl
2026-03-27 14:35:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 32,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 32,
 'downloader/request_bytes': 906619,
 'downloader/request_count': 142,
 'downloader/request_method_count/GET': 142,
 'downloader/response_bytes': 8214873,
 'downloader/response_count': 110,
 'downloader/response_status_count/200': 108,
 'downloader/response_status_count/403': 2,
 'elapsed_time_seconds': 329.321709,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 14, 35, 34, 986865, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 858506,
 'httpcompression/response_count': 6,
 'item_scraped_count': 17,
 'log_count/DEBUG': 1571,
 'log_count/ERROR': 96,
 'log_count/INFO': 548,
 'log_count/WARNING': 85,
 'memusage/max': 220979200,
 'memusage/startup': 149884928,
 'photo_download_count': 78,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 356,
 'playwright/request_count/aborted': 174,
 'playwright/request_count/method/GET': 325,
 'playwright/request_count/method/POST': 31,
 'playwright/request_count/navigation': 5,
 'playwright/request_count/resource_type/document': 5,
 'playwright/request_count/resource_type/fetch': 5,
 'playwright/request_count/resource_type/font': 18,
 'playwright/request_count/resource_type/image': 168,
 'playwright/request_count/resource_type/other': 3,
 'playwright/request_count/resource_type/script': 90,
 'playwright/request_count/resource_type/stylesheet': 34,
 'playwright/request_count/resource_type/xhr': 33,
 'playwright/response_count': 178,
 'playwright/response_count/method/GET': 151,
 'playwright/response_count/method/POST': 27,
 'playwright/response_count/resource_type/document': 5,
 'playwright/response_count/resource_type/fetch': 5,
 'playwright/response_count/resource_type/font': 18,
 'playwright/response_count/resource_type/other': 3,
 'playwright/response_count/resource_type/script': 84,
 'playwright/response_count/resource_type/stylesheet': 34,
 'playwright/response_count/resource_type/xhr': 29,
 'request_depth_max': 2,
 'response_received_count': 32,
 'scheduler/dequeued': 142,
 'scheduler/dequeued/memory': 142,
 'scheduler/enqueued': 142,
 'scheduler/enqueued/memory': 142,
 'scrape_type/new': 29,
 'scrape_type/skipped': 21,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 31,
 'scrapy-zyte-api/error_ratio': 0.06451612903225806,
 'scrapy-zyte-api/errors': 2,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 2,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 47.13817594315985,
 'scrapy-zyte-api/mean_response_seconds': 47.30696944500608,
 'scrapy-zyte-api/processed': 29,
 'scrapy-zyte-api/request_args/actions': 29,
 'scrapy-zyte-api/request_args/browserHtml': 29,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 29,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 29,
 'scrapy-zyte-api/request_args/requestHeaders': 29,
 'scrapy-zyte-api/request_args/sessionContext': 29,
 'scrapy-zyte-api/request_args/url': 29,
 'scrapy-zyte-api/status_codes/0': 2,
 'scrapy-zyte-api/status_codes/200': 29,
 'scrapy-zyte-api/success': 29,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/ValueError': 12,
 'start_time': datetime.datetime(2026, 3, 27, 14, 30, 5, 665156, tzinfo=datetime.timezone.utc)}
2026-03-27 14:35:35 [scrapy.core.engine] INFO: Spider closed (finished)

/1/log/utf8/sourcing_v2/sytner.gb/task_11_2026-03-27T14_30_00/?job_finished=True

http://scrapyd-0:6800/logs/sourcing_v2/sytner.gb/task_11_2026-03-27T14_30_00.log