Head
2026-03-31 21:12:46 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-31 21:12:46 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-31 21:12:46 [auto_selling_coches.net.api] INFO: Starting auto_selling_coches.net.api spider (API-based)
2026-03-31 21:12:46 [auto_selling_coches.net.api] INFO: Extracted dealer slug: integracars
2026-03-31 21:12:46 [auto_selling_coches.net.api] INFO: _job: 79c7fbc42ce811f19724def17024dec4, SCRAPY_JOB: None
2026-03-31 21:12:46 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-31 21:12:46 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-31 21:12:46 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-31 21:12:46 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-31 21:12:46 [scrapy.extensions.telnet] INFO: Telnet Password: d26c3f9211e3b15a
2026-03-31 21:12:46 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-31 21:12:46 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'CONCURRENT_REQUESTS': 5,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_coches.net.api/79c7fbc42ce811f19724def17024dec4.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-31 21:12:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-31 21:12:46 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-31 21:12:46 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-31 21:12:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-31 21:12:46 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-31 21:12:46 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-31 21:12:46 [scrapy.core.engine] INFO: Spider opened
2026-03-31 21:12:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-31 21:12:46 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-31 21:12:46 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-31 21:12:46 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-31 21:12:46 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-31 21:12:46 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-31 21:12:46 [scrapy-playwright] INFO: Starting download handler
2026-03-31 21:12:46 [scrapy-playwright] INFO: Starting download handler
2026-03-31 21:12:51 [auto_selling_coches.net.api] INFO: API spider started with URL: https://www.coches.net/concesionario/integracars, dealer_slug: integracars
2026-03-31 21:12:51 [auto_selling_coches.net.api] INFO: Trying fast dealer API: https://web.gw.coches.net/dealers/integracars
2026-03-31 21:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:12:52 [scrapy.core.engine] DEBUG: Crawled (400) <GET https://web.gw.coches.net/dealers/integracars> (referer: None) ['zyte-api']
2026-03-31 21:12:52 [auto_selling_coches.net.api] INFO: Search API failed (Ignoring non-200 response), falling back to browserHtml
2026-03-31 21:12:52 [auto_selling_coches.net.api] INFO: Using browserHtml fallback path (page 1)
2026-03-31 21:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.coches.net/concesionario/integracars?pg=1> (referer: None) ['zyte-api']
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Total items from HTML header: 23
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Extracting listings from HTML page 1
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Found 23 listings in HTML (page 1)
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Found listing with ID: 70315294
2026-03-31 21:13:13 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-31 21:13:13 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770315294%27 HTTP/1.1" 200 None
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Scrape type for 70315294: 1
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Scraping new listing 70315294
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Found listing with ID: 70314294
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770314294%27 HTTP/1.1" 200 None
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Scrape type for 70314294: 1
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Scraping new listing 70314294
2026-03-31 21:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:13:13 [auto_selling_coches.net.api] INFO: Found listing with ID: 70317097
Tail
'\n'
'SIGUENOS EN @integracars',
'doors_number': 2,
'emission_standard': 'C',
'engine': '4.0L',
'engine_horse_power': 585,
'expiration_date': None,
'fuel_type': 'Gasolina',
'id': '11465ae2-5377-5664-ba8b-39c9a1788d5c',
'is_damaged': False,
'is_operable': True,
'license_plate': None,
'link_to_web_offer': 'https://www.coches.net/mercedes-benz-mercedes-amg-sl-mercedesamg-sl-63-4matic-2p-gasolina-2024-en-barcelona-70317268-covo.aspx',
'listing': 'auction',
'location': 'Barcelona',
'make': 'MERCEDES-BENZ',
'model': 'Mercedes-AMG SL',
'odometer': 15000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 1,
'photo_urls': ['https://a.ccdn.es/cnet/vehicles/19770874/18fc1f9b-5b9f-4e0e-bbd5-204dd6af4d5e.jpg'],
'photos': [],
'price': 182900,
'price_includes_vat': True,
'registration_date': '2023-01-01',
'seats_number': 4,
'seller_name': None,
'title': 'MERCEDES-BENZ Mercedes-AMG SL MercedesAMG SL 63 4MATIC',
'transmission': 'automatic',
'trim': 'MercedesAMG SL 63 4MATIC',
'vin': None,
'year': 2023}
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770317268%27 HTTP/1.1" 200 None
2026-03-31 21:25:19 [auto_selling_coches.net.api] INFO: Saving data for 70317268: {'created_time': 1774992319.223623, 'last_price_update_time': 1774992319.223632}
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net.api',RowKey='70317268') HTTP/1.1" 204 0
2026-03-31 21:25:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 11465ae2-5377-5664-ba8b-39c9a1788d5c due to User timeout caused connection failure: Getting https://a.ccdn.es/cnet/vehicles/19770874/18fc1f9b-5b9f-4e0e-bbd5-204dd6af4d5e.jpg took longer than 180.0 seconds..
2026-03-31 21:25:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7ffd9aff-bd20-5667-a7ec-40e9f899c050 with identifier 70316686
2026-03-31 21:25:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:25:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:25:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7ffd9aff-bd20-5667-a7ec-40e9f899c050
2026-03-31 21:25:19 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://a.ccdn.es/cnet/vehicles/19770343/183ac61d-e42a-4cff-8f53-2bc03e66f984.jpg took longer than 180.0 seconds..
{'auction_title': '',
'body_type': 'Coupe',
'c_o_2_emission_value': 298,
'category': 'Coches',
'color': 'Negro',
'currency': 'EUR',
'description': '¡¡¡ESPECTACULAR PORSHCE 997.2 GT3!!!\n'
'\n'
'PARA ENTREGA INMEDIATA\n'
'\n'
'GARANTIA 12 MESES PREMIUM RENOVABLE\n'
'\n'
'REVISIONES AL DIA EN CONCESIONARIO OFICIAL PORSCHE, FLAT 6 Y '
'JULIA\n'
'\n'
'LIBRO DE REVISIONES SELLADO Y CON FACTURAS\n'
'\n'
'ESTADO IMPOLUTO\n'
'\n'
'EXTRAS DESTACABLES:\n'
'Paquete de sonido Plus\n'
'Faros halógenos de bajo peso\n'
'SOFTWARE NAVEGACIÓN "PAQUETE EUROPA"\n'
'Paquete Sport Chrono Plus\n'
'Alfombrillas en color interior\n'
'Jaula antivuelco\n'
'Interfaz para reproductor externo\n'
'Asientos Bucket RECARO\n'
'Porsche Communication Management (PCM)\n'
'Cinturones de seguridad en Amarillo Speed\n'
'Interior en alcántara y carbono \n'
'\n'
'ACEPTAMOS COCHE COMO PARTE DE PAGO.\n'
'ENTREGAMOS VEHÍCULO EN TODA ESPAÑA.\n'
'FINANCIACIÓN A MEDIDA.\n'
'\n'
'*Ninguna oferta es vinculante. Reservado el derecho a su '
'venta final y a posibles modificaciones. \n'
'*Anuncio sujeto a errores\n'
'\n'
'SIGUENOS EN INSTAGRAM @integracars',
'doors_number': 2,
'emission_standard': 'C',
'engine': '3.8L',
'engine_horse_power': 435,
'expiration_date': None,
'fuel_type': 'Gasolina',
'id': '7ffd9aff-bd20-5667-a7ec-40e9f899c050',
'is_damaged': False,
'is_operable': True,
'license_plate': None,
'link_to_web_offer': 'https://www.coches.net/porsche-911-gt3-2p-gasolina-2010-en-barcelona-70316686-covo.aspx',
'listing': 'auction',
'location': 'Barcelona',
'make': 'PORSCHE',
'model': '911',
'odometer': 60000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 1,
'photo_urls': ['https://a.ccdn.es/cnet/vehicles/19770343/183ac61d-e42a-4cff-8f53-2bc03e66f984.jpg'],
'photos': [],
'price': 135997,
'price_includes_vat': True,
'registration_date': '2010-01-01',
'seats_number': 2,
'seller_name': None,
'title': 'PORSCHE 911 GT3',
'transmission': 'automatic',
'trim': 'GT3',
'vin': None,
'year': 2010}
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770316686%27 HTTP/1.1" 200 None
2026-03-31 21:25:19 [auto_selling_coches.net.api] INFO: Saving data for 70316686: {'created_time': 1774992319.389869, 'last_price_update_time': 1774992319.389884}
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net.api',RowKey='70316686') HTTP/1.1" 204 0
2026-03-31 21:25:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7ffd9aff-bd20-5667-a7ec-40e9f899c050 due to User timeout caused connection failure: Getting https://a.ccdn.es/cnet/vehicles/19770343/183ac61d-e42a-4cff-8f53-2bc03e66f984.jpg took longer than 180.0 seconds..
2026-03-31 21:25:19 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-31 21:25:19 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-31 21:25:19 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-31 21:25:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:25:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:25:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 79c7fbc42ce811f19724def17024dec4
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-31 21:25:19 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-31 21:25:19 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:25:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:25:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-31 21:25:19 [auto_selling_coches.net.api] INFO: auto_selling_coches.net.api Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20last_price_update_time%20lt%201773696319 HTTP/1.1" 200 None
2026-03-31 21:25:19 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (23 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_coches.net.api/79c7fbc42ce811f19724def17024dec4.jl
2026-03-31 21:25:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 19,
'downloader/exception_type_count/twisted.internet.error.ConnectError': 1,
'downloader/exception_type_count/twisted.internet.error.TimeoutError': 18,
'downloader/request_bytes': 46060,
'downloader/request_count': 44,
'downloader/request_method_count/GET': 44,
'downloader/response_bytes': 2255265,
'downloader/response_count': 25,
'downloader/response_status_count/200': 24,
'downloader/response_status_count/400': 1,
'elapsed_time_seconds': 753.424227,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 31, 21, 25, 19, 854009, tzinfo=datetime.timezone.utc),
'item_scraped_count': 23,
'log_count/DEBUG': 371,
'log_count/INFO': 296,
'memusage/max': 179036160,
'memusage/startup': 149127168,
'request_depth_max': 3,
'response_received_count': 25,
'scheduler/dequeued': 44,
'scheduler/dequeued/memory': 44,
'scheduler/enqueued': 44,
'scheduler/enqueued/memory': 44,
'scrape_type/new': 23,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 25,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.9062273169681427,
'scrapy-zyte-api/mean_response_seconds': 1.9635672752559181,
'scrapy-zyte-api/processed': 25,
'scrapy-zyte-api/request_args/actions': 1,
'scrapy-zyte-api/request_args/browserHtml': 1,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 24,
'scrapy-zyte-api/request_args/experimental.requestCookies': 24,
'scrapy-zyte-api/request_args/experimental.responseCookies': 25,
'scrapy-zyte-api/request_args/httpResponseBody': 24,
'scrapy-zyte-api/request_args/httpResponseHeaders': 24,
'scrapy-zyte-api/request_args/url': 25,
'scrapy-zyte-api/status_codes/200': 25,
'scrapy-zyte-api/success': 25,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 31, 21, 12, 46, 429782, tzinfo=datetime.timezone.utc)}
2026-03-31 21:25:19 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-31 21:25:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6efcd8fb10>
2026-03-31 21:25:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6efcd983d0>