Head
2026-03-26 15:37:19 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 15:37:19 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 15:37:19 [auto_selling_coches.net] INFO: Starting auto_selling_coches.net spider
2026-03-26 15:37:19 [auto_selling_coches.net] INFO: _job: a9eb6222292911f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 15:37:19 [auto_selling_coches.net] INFO: Quick mode enabled - reduced wait times and single photo per item
2026-03-26 15:37:19 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 15:37:19 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 15:37:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 15:37:19 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 15:37:19 [scrapy.extensions.telnet] INFO: Telnet Password: 1067cab5d1ec5f64
2026-03-26 15:37:19 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-26 15:37:19 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'CONCURRENT_REQUESTS': 5,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_coches.net/a9eb6222292911f18f76c264925fbcfa.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-26 15:37:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 15:37:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 15:37:19 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 15:37:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 15:37:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 15:37:20 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 15:37:20 [scrapy.core.engine] INFO: Spider opened
2026-03-26 15:37:20 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-26 15:37:20 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 15:37:20 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 15:37:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 15:37:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 15:37:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 15:37:20 [scrapy-playwright] INFO: Starting download handler
2026-03-26 15:37:20 [scrapy-playwright] INFO: Starting download handler
2026-03-26 15:37:25 [auto_selling_coches.net] INFO: Scraper started with URL: https://www.coches.net/concesionario/jcararrigorriaga and multipost_profile_id: 6ea19274-d661-4e31-b2ef-efbcf60b3c59 and job_id: a9eb6222292911f18f76c264925fbcfa
2026-03-26 15:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 15:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.coches.net/concesionario/jcararrigorriaga> (referer: None) ['zyte-api']
2026-03-26 15:37:29 [auto_selling_coches.net] INFO: response: <200 https://www.coches.net/concesionario/jcararrigorriaga/>
2026-03-26 15:37:29 [auto_selling_coches.net] INFO: Title at home page 5 Vehículos
2026-03-26 15:37:29 [auto_selling_coches.net] INFO: Total number of items: 5
2026-03-26 15:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 15:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.coches.net/concesionario/jcararrigorriaga?pg=1> (referer: https://www.coches.net/concesionario/jcararrigorriaga/) ['zyte-api']
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Parsing page 1
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Found 5 listings on page 1
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Found listing with ID: 70144912
2026-03-26 15:37:32 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 15:37:32 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net%27%20and%20RowKey%20eq%20%2770144912%27 HTTP/1.1" 200 None
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Scrape type for 70144912: 1
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Scraping new listing 70144912
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Found listing with ID: 70102297
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net%27%20and%20RowKey%20eq%20%2770102297%27 HTTP/1.1" 200 None
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Scrape type for 70102297: 1
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Scraping new listing 70102297
2026-03-26 15:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 15:37:32 [auto_selling_coches.net] INFO: Found listing with ID: 70034608
2026-03-26 15:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
Tail
'automático garantizan una experiencia de conducción segura y '
'confortable para cualquier persona al volante.\n'
'Techo panorámico \n'
'Llanta 21”',
'doors_number': 5,
'emission_standard': 'ECO',
'engine': '3.0L',
'engine_horse_power': 341,
'expiration_date': None,
'fuel_type': 'Híbrido',
'id': '50e5d1e1-8a2c-50f4-99cf-67be9337df66',
'is_damaged': False,
'is_operable': True,
'license_plate': None,
'link_to_web_offer': 'https://www.coches.net/audi-q5-sportback-sq5-tdi-quattro-5p-electrico-hibrido-2022-en-vizcaya-70144912-covo.aspx',
'listing': 'auction',
'location': 'Bizkaia',
'make': 'AUDI',
'model': 'Q5 SPORTBACK',
'odometer': 94000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5d1e1-8a2c-50f4-99cf-67be9337df66/50e5d1e1-8a2c-50f4-99cf-67be9337df66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62325,
'Height': 600,
'OriginUrl': 'https://a.ccdn.es/cnet/vehicles/19637078/6ef1b1ff-7bcc-4108-a1e0-c6b56baf27e9.jpg',
'Width': 800}],
'price': 64999,
'price_includes_vat': True,
'registration_date': '2021-01-01',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q5 SPORTBACK SQ5 TDI Quattro',
'transmission': 'automatic',
'trim': 'SQ5 TDI Quattro',
'vin': None,
'year': 2021}
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net%27%20and%20RowKey%20eq%20%2770144912%27 HTTP/1.1" 200 None
2026-03-26 15:37:35 [auto_selling_coches.net] INFO: Saving data for 70144912: {'created_time': 1774539455.699787, 'last_price_update_time': 1774539455.699793}
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='70144912') HTTP/1.1" 204 0
2026-03-26 15:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://a.ccdn.es/cnet/vehicles/19547335/3c3f52f3-31f6-43f7-b76f-cee95d62ee03.jpg> (referer: None)
2026-03-26 15:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 15:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc7035f210>
2026-03-26 15:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 15:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c604f7-d2a7-5d32-91c2-19b02d3e15b9/b4c604f7-d2a7-5d32-91c2-19b02d3e15b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_coches.net',RowKey='https%3A%252F%252Fa.ccdn.es%252Fcnet%252Fvehicles%252F19547335%252F3c3f52f3-31f6-43f7-b76f-cee95d62ee03.jpg') HTTP/1.1" 204 0
2026-03-26 15:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://a.ccdn.es/cnet/vehicles/19547335/3c3f52f3-31f6-43f7-b76f-cee95d62ee03.jpg saved to cache
2026-03-26 15:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4c604f7-d2a7-5d32-91c2-19b02d3e15b9
2026-03-26 15:37:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4c604f7-d2a7-5d32-91c2-19b02d3e15b9 sending to next pipeline
2026-03-26 15:37:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b4c604f7-d2a7-5d32-91c2-19b02d3e15b9 with identifier 70034608
2026-03-26 15:37:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 15:37:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 15:37:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b4c604f7-d2a7-5d32-91c2-19b02d3e15b9
2026-03-26 15:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://a.ccdn.es/cnet/vehicles/19547335/3c3f52f3-31f6-43f7-b76f-cee95d62ee03.jpg>
{'auction_title': '',
'body_type': 'Berlina',
'c_o_2_emission_value': 152,
'category': 'Coches',
'color': 'Azul',
'currency': 'EUR',
'description': 'Audi a5 2.0tfsi Sline 185 CV\n'
'Manual \n'
'Techo solarpaqute sline interior y exterior \n'
'Asientos piel tela con logo sline\n'
'Volante deportivo sline \n'
'Llanta 19”\n'
'Faros Xenon \n'
'Luces automáticas \n'
'Limpias automáticos \n'
'Cristales traseros oscurecidos \n'
'Volante multifuncion \n'
'….',
'doors_number': 5,
'emission_standard': 'C',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': None,
'fuel_type': 'Gasolina',
'id': 'b4c604f7-d2a7-5d32-91c2-19b02d3e15b9',
'is_damaged': False,
'is_operable': True,
'license_plate': None,
'link_to_web_offer': 'https://www.coches.net/audi-a5-sportback-20-tfsi-180cv-5p-gasolina-2010-en-vizcaya-70034608-covo.aspx',
'listing': 'auction',
'location': 'Bizkaia',
'make': 'AUDI',
'model': 'A5',
'odometer': 141000,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c604f7-d2a7-5d32-91c2-19b02d3e15b9/b4c604f7-d2a7-5d32-91c2-19b02d3e15b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139893,
'Height': 600,
'OriginUrl': 'https://a.ccdn.es/cnet/vehicles/19547335/3c3f52f3-31f6-43f7-b76f-cee95d62ee03.jpg',
'Width': 800}],
'price': 12999,
'price_includes_vat': True,
'registration_date': '2009-01-01',
'seats_number': 4,
'seller_name': None,
'title': 'AUDI A5 Sportback 2.0 TFSI',
'transmission': 'manual',
'trim': 'Sportback 2.0 TFSI 180cv',
'vin': None,
'year': 2009}
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net%27%20and%20RowKey%20eq%20%2770034608%27 HTTP/1.1" 200 None
2026-03-26 15:37:35 [auto_selling_coches.net] INFO: Saving data for 70034608: {'created_time': 1774539455.952392, 'last_price_update_time': 1774539455.952401}
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='70034608') HTTP/1.1" 204 0
2026-03-26 15:37:35 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 15:37:35 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 15:37:35 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 15:37:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 15:37:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 15:37:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item a9eb6222292911f18f76c264925fbcfa
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 15:37:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 15:37:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 15:37:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 15:37:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 15:37:36 [auto_selling_coches.net] INFO: auto_selling_coches.net Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 5, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 15:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net%27%20and%20last_price_update_time%20lt%201773243456 HTTP/1.1" 200 None
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='61101630') HTTP/1.1" 204 0
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='61926283') HTTP/1.1" 204 0
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='62250564') HTTP/1.1" 204 0
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='62418549') HTTP/1.1" 204 0
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='62616889') HTTP/1.1" 204 0
2026-03-26 15:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_coches.net',RowKey='62621498') HTTP/1.1" 204 0
2026-03-26 15:37:37 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (5 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_coches.net/a9eb6222292911f18f76c264925fbcfa.jl
2026-03-26 15:37:37 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 4893,
'downloader/request_count': 12,
'downloader/request_method_count/GET': 12,
'downloader/response_bytes': 3288591,
'downloader/response_count': 12,
'downloader/response_status_count/200': 12,
'elapsed_time_seconds': 17.013573,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 26, 15, 37, 37, 75147, tzinfo=datetime.timezone.utc),
'httpcompression/response_bytes': 614051,
'httpcompression/response_count': 5,
'item_scraped_count': 5,
'log_count/DEBUG': 130,
'log_count/INFO': 146,
'memusage/max': 146968576,
'memusage/startup': 146968576,
'photo_download_count': 5,
'request_depth_max': 3,
'response_received_count': 7,
'scheduler/dequeued': 12,
'scheduler/dequeued/memory': 12,
'scheduler/enqueued': 12,
'scheduler/enqueued/memory': 12,
'scrape_type/new': 5,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 7,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.6574964553250797,
'scrapy-zyte-api/mean_response_seconds': 1.7884386770560274,
'scrapy-zyte-api/processed': 7,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
'scrapy-zyte-api/request_args/experimental.requestCookies': 6,
'scrapy-zyte-api/request_args/experimental.responseCookies': 7,
'scrapy-zyte-api/request_args/httpResponseBody': 7,
'scrapy-zyte-api/request_args/httpResponseHeaders': 7,
'scrapy-zyte-api/request_args/url': 7,
'scrapy-zyte-api/status_codes/200': 7,
'scrapy-zyte-api/success': 7,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 26, 15, 37, 20, 61574, tzinfo=datetime.timezone.utc)}
2026-03-26 15:37:37 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 15:37:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcc7512af90>
2026-03-26 15:37:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcc7512b790>