Desktop version Jobs
  • Analysis
  • Categories
  • Charts
  • Logs
  • Crawler.stats
  • projectsourcing_v2
    spiderauto_selling_coches.net.api
    job4a46679c2c1f11f18e133aacc95538c6
    first_log_time2026-03-30 15:00:22
    latest_log_time2026-03-30 15:03:40
    runtime0:03:18
    crawled_pages 61
    scraped_items 58
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count2
    log_warning_count0
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

    • error_logs
      2 in total

      2026-03-30 15:03:40 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f011617b110>
      2026-03-30 15:03:40 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f011617b910>

      INFO

      DEBUG

    • scrapy_version

      2.11.2
    • telnet_console

      127.0.0.1:6025
    • telnet_password

      cc601971253c588d
    • latest_crawl

      2026-03-30 15:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://web.gw.coches.net/details/70275334> (referer: https://www.coches.net/concesionario/blhmotor2017/?pg=2) ['zyte-api']
    • latest_scrape

      2026-03-30 15:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://web.gw.coches.net/details/70275334>
    • latest_stat

      2026-03-30 15:03:22 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 16 pages/min), scraped 56 items (at 16 items/min)
    • Head

      2026-03-30 15:00:22 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
      2026-03-30 15:00:22 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
      2026-03-30 15:00:22 [auto_selling_coches.net.api] INFO: Starting auto_selling_coches.net.api spider (API-based)
      2026-03-30 15:00:22 [auto_selling_coches.net.api] INFO: Extracted dealer slug: blhmotor2017
      2026-03-30 15:00:22 [auto_selling_coches.net.api] INFO: _job: 4a46679c2c1f11f18e133aacc95538c6, SCRAPY_JOB: None
      2026-03-30 15:00:22 [scrapy.addons] INFO: Enabled addons:
      []
      2026-03-30 15:00:22 [asyncio] DEBUG: Using selector: EpollSelector
      2026-03-30 15:00:22 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-03-30 15:00:22 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-03-30 15:00:22 [scrapy.extensions.telnet] INFO: Telnet Password: cc601971253c588d
      2026-03-30 15:00:22 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.closespider.CloseSpider']
      2026-03-30 15:00:22 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'SourcingV2',
       'CLOSESPIDER_TIMEOUT': 3600,
       'CONCURRENT_REQUESTS': 5,
       'DOWNLOAD_MAXSIZE': 52428800,
       'DOWNLOAD_WARNSIZE': 10485760,
       'FEED_EXPORT_ENCODING': 'utf-8',
       'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_coches.net.api/4a46679c2c1f11f18e133aacc95538c6.log',
       'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
       'MEMUSAGE_LIMIT_MB': 2048,
       'MEMUSAGE_WARNING_MB': 1536,
       'NEWSPIDER_MODULE': 'spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
       'SPIDER_MODULES': ['spiders', 'auth_check'],
       'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
       'USER_AGENT': ''}
      2026-03-30 15:00:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-30 15:00:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-30 15:00:22 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-03-30 15:00:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
      2026-03-30 15:00:22 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
       'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
      2026-03-30 15:00:22 [scrapy.middleware] INFO: Enabled item pipelines:
      ['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
       'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
      2026-03-30 15:00:22 [scrapy.core.engine] INFO: Spider opened
      2026-03-30 15:00:22 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
      2026-03-30 15:00:22 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
      2026-03-30 15:00:22 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
      2026-03-30 15:00:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-03-30 15:00:22 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
      2026-03-30 15:00:22 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
      2026-03-30 15:00:22 [scrapy-playwright] INFO: Starting download handler
      2026-03-30 15:00:22 [scrapy-playwright] INFO: Starting download handler
      2026-03-30 15:00:27 [auto_selling_coches.net.api] INFO: API spider started with URL: https://www.coches.net/concesionario/blhmotor2017, dealer_slug: blhmotor2017
      2026-03-30 15:00:27 [auto_selling_coches.net.api] INFO: Trying fast dealer API: https://web.gw.coches.net/dealers/blhmotor2017
      2026-03-30 15:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      2026-03-30 15:00:28 [scrapy.core.engine] DEBUG: Crawled (400) <GET https://web.gw.coches.net/dealers/blhmotor2017> (referer: None) ['zyte-api']
      2026-03-30 15:00:28 [auto_selling_coches.net.api] INFO: Search API failed (Ignoring non-200 response), falling back to browserHtml
      2026-03-30 15:00:28 [auto_selling_coches.net.api] INFO: Using browserHtml fallback path (page 1)
      
      2026-03-30 15:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      2026-03-30 15:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.coches.net/concesionario/blhmotor2017?pg=1> (referer: None) ['zyte-api']
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Total items from HTML header: 58
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Extracting listings from HTML page 1
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Found 30 listings in HTML (page 1)
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Found listing with ID: 70291584
      2026-03-30 15:00:50 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
      
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
      2026-03-30 15:00:50 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770291584%27 HTTP/1.1" 200 None
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Scrape type for 70291584: 1
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Scraping new listing 70291584
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Found listing with ID: 70294596
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770294596%27 HTTP/1.1" 200 None
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Scrape type for 70294596: 1
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Scraping new listing 70294596
      2026-03-30 15:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      2026-03-30 15:00:50 [auto_selling_coches.net.api] INFO: Found listing with ID: 70294595
    • Tail

       'make': 'PORSCHE',
       'model': 'Cayenne',
       'odometer': 161000,
       'odometer_reading_unit': 'km',
       'origin_country_code': 'ES',
       'original_photo_count': 1,
       'photo_urls': ['https://a.ccdn.es/cnet/vehicles/19738096/00e81c53-1353-4e46-a690-3255bfa8dfe2.jpg'],
       'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19e8c53b-561a-5f70-8bda-a594024412f9/19e8c53b-561a-5f70-8bda-a594024412f9_image_0.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 55304,
                   'Height': 600,
                   'OriginUrl': 'https://a.ccdn.es/cnet/vehicles/19738096/00e81c53-1353-4e46-a690-3255bfa8dfe2.jpg',
                   'Width': 800}],
       'price': 34990,
       'price_includes_vat': True,
       'registration_date': '2015-01-01',
       'seats_number': 5,
       'seller_name': None,
       'title': 'PORSCHE Cayenne Diesel',
       'transmission': 'automatic',
       'trim': 'Diesel',
       'vin': None,
       'year': 2015}
      2026-03-30 15:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770279374%27 HTTP/1.1" 200 None
      2026-03-30 15:03:36 [auto_selling_coches.net.api] INFO: Saving data for 70279374: {'created_time': 1774883016.879434, 'last_price_update_time': 1774883016.879444}
      2026-03-30 15:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net.api',RowKey='70279374') HTTP/1.1" 204 0
      2026-03-30 15:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://web.gw.coches.net/details/70275334> (referer: https://www.coches.net/concesionario/blhmotor2017/?pg=2) ['zyte-api']
      2026-03-30 15:03:39 [auto_selling_coches.net.api] INFO: Extracted item from API: 70275334 - SKODA Octavia Combi 2.0 TSI RS
      2026-03-30 15:03:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb4a101-9253-51ae-9941-d1d339dfd150 with identifier: 70275334
      2026-03-30 15:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecb4a101-9253-51ae-9941-d1d339dfd150
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fa.ccdn.es%252Fcnet%252Fvehicles%252F19734596%252F1cb1ac0d-ffec-4ee6-b56d-5f531d62530e.jpg%27 HTTP/1.1" 200 None
      2026-03-30 15:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://a.ccdn.es/cnet/vehicles/19734596/1cb1ac0d-ffec-4ee6-b56d-5f531d62530e.jpg already downloaded
      2026-03-30 15:03:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ecb4a101-9253-51ae-9941-d1d339dfd150 with identifier 70275334
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
      2026-03-30 15:03:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ecb4a101-9253-51ae-9941-d1d339dfd150
      2026-03-30 15:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://web.gw.coches.net/details/70275334>
      {'auction_title': '',
       'body_type': 'Familiar',
       'c_o_2_emission_value': 175,
       'category': 'Coches',
       'color': 'Azul',
       'currency': 'EUR',
       'description': 'SKODA OCTAVIA COMBI 2.0 TSI RS 220CV 5P\n'
                      '\n'
                      '10/2013\n'
                      '134.000 KM\n'
                      'LIBRO DE MANTENIMIENTO\n'
                      'ETIQUETA MEDIOAMBIENTAL C\n'
                      'Bi xenón\n'
                      'Asientos delanteros calefactables\n'
                      'Tapicería mixta piel/alcántara\n'
                      'Pantalla Android\n'
                      'Bluetooth audio\n'
                      'Sensor de aparcamiento del. y tras.\n'
                      'Sensor de luces y lluvia\n'
                      'Sensor de presión de Neumáticos\n'
                      'Asistente en pendientes \n'
                      'Portón trasero eléctrico\n'
                      'Reconocimiento de señales de trafico\n'
                      'Tempomat\n'
                      'Arranque sin llave\n'
                      'Climatizador bi zona\n'
                      'Volante multifunción\n'
                      'Ordenador de abordo\n'
                      'Espejos eléctricos\n'
                      '———————————————\n'
                      '* Gestión documental +250€\n'
                      '* Se entrega recién Revisado\n'
                      '* 12 meses de garantía a nivel nacional\n'
                      '* Kilómetros certificados\n'
                      '* Recogemos su vehículo a cambio\n'
                      '* Posibilidad de financiación con o sin entrada\n'
                      '* Compramos su vehículo o hacemos gestión\n'
                      '* Posibilidad de enviarlo a la puerta de su casa. '
                      '(Consultar)\n'
                      '* Este anuncio no es vinculante, puede contener errores, se '
                      'muestra a título informativo y no contractual',
       'doors_number': 5,
       'emission_standard': 'C',
       'engine': '2.0L',
       'engine_horse_power': 200,
       'expiration_date': None,
       'fuel_type': 'Gasolina',
       'id': 'ecb4a101-9253-51ae-9941-d1d339dfd150',
       'is_damaged': False,
       'is_operable': True,
       'license_plate': None,
       'link_to_web_offer': 'https://www.coches.net/skoda-octavia-combi-20-tsi-rs-5p-gasolina-2013-en-barcelona-70275334-covo.aspx',
       'listing': 'auction',
       'location': 'Barcelona',
       'make': 'SKODA',
       'model': 'Octavia',
       'odometer': 139000,
       'odometer_reading_unit': 'km',
       'origin_country_code': 'ES',
       'original_photo_count': 1,
       'photo_urls': ['https://a.ccdn.es/cnet/vehicles/19734596/1cb1ac0d-ffec-4ee6-b56d-5f531d62530e.jpg'],
       'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb4a101-9253-51ae-9941-d1d339dfd150/ecb4a101-9253-51ae-9941-d1d339dfd150_image_0.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 62885,
                   'Height': 600,
                   'OriginUrl': 'https://a.ccdn.es/cnet/vehicles/19734596/1cb1ac0d-ffec-4ee6-b56d-5f531d62530e.jpg',
                   'Width': 800}],
       'price': 15990,
       'price_includes_vat': True,
       'registration_date': '2013-01-01',
       'seats_number': 5,
       'seller_name': None,
       'title': 'SKODA Octavia Combi 2.0 TSI RS',
       'transmission': 'manual',
       'trim': 'Combi 2.0 TSI RS',
       'vin': None,
       'year': 2013}
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20RowKey%20eq%20%2770275334%27 HTTP/1.1" 200 None
      2026-03-30 15:03:39 [auto_selling_coches.net.api] INFO: Saving data for 70275334: {'created_time': 1774883019.685318, 'last_price_update_time': 1774883019.685329}
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_coches.net.api',RowKey='70275334') HTTP/1.1" 204 0
      2026-03-30 15:03:39 [scrapy.core.engine] INFO: Closing spider (finished)
      2026-03-30 15:03:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
      2026-03-30 15:03:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
      2026-03-30 15:03:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a46679c2c1f11f18e133aacc95538c6
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
      2026-03-30 15:03:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
      2026-03-30 15:03:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
      2026-03-30 15:03:39 [auto_selling_coches.net.api] INFO: auto_selling_coches.net.api Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
      2026-03-30 15:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-30 15:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_coches.net.api%27%20and%20last_price_update_time%20lt%201773587020 HTTP/1.1" 200 None
      2026-03-30 15:03:40 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (58 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_coches.net.api/4a46679c2c1f11f18e133aacc95538c6.jl
      2026-03-30 15:03:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
      {'downloader/request_bytes': 117900,
       'downloader/request_count': 61,
       'downloader/request_method_count/GET': 61,
       'downloader/response_bytes': 4423604,
       'downloader/response_count': 61,
       'downloader/response_status_count/200': 60,
       'downloader/response_status_count/400': 1,
       'elapsed_time_seconds': 197.375657,
       'feedexport/success_count/FileFeedStorage': 1,
       'finish_reason': 'finished',
       'finish_time': datetime.datetime(2026, 3, 30, 15, 3, 40, 233720, tzinfo=datetime.timezone.utc),
       'item_scraped_count': 58,
       'log_count/DEBUG': 843,
       'log_count/INFO': 597,
       'memusage/max': 182743040,
       'memusage/startup': 147550208,
       'request_depth_max': 3,
       'response_received_count': 61,
       'scheduler/dequeued': 61,
       'scheduler/dequeued/memory': 61,
       'scheduler/enqueued': 61,
       'scheduler/enqueued/memory': 61,
       'scrape_type/new': 58,
       'scrapy-zyte-api/429': 0,
       'scrapy-zyte-api/attempts': 62,
       'scrapy-zyte-api/error_ratio': 0.016129032258064516,
       'scrapy-zyte-api/error_types/download/website-ban': 1,
       'scrapy-zyte-api/errors': 1,
       'scrapy-zyte-api/fatal_errors': 0,
       'scrapy-zyte-api/mean_connection_seconds': 7.112289322810547,
       'scrapy-zyte-api/mean_response_seconds': 6.782125306666874,
       'scrapy-zyte-api/processed': 61,
       'scrapy-zyte-api/request_args/actions': 2,
       'scrapy-zyte-api/request_args/browserHtml': 2,
       'scrapy-zyte-api/request_args/customHttpRequestHeaders': 59,
       'scrapy-zyte-api/request_args/experimental.requestCookies': 60,
       'scrapy-zyte-api/request_args/experimental.responseCookies': 61,
       'scrapy-zyte-api/request_args/httpResponseBody': 59,
       'scrapy-zyte-api/request_args/httpResponseHeaders': 59,
       'scrapy-zyte-api/request_args/requestHeaders': 1,
       'scrapy-zyte-api/request_args/url': 61,
       'scrapy-zyte-api/status_codes/200': 61,
       'scrapy-zyte-api/status_codes/520': 1,
       'scrapy-zyte-api/success': 61,
       'scrapy-zyte-api/success_ratio': 1.0,
       'scrapy-zyte-api/throttle_ratio': 0.0,
       'start_time': datetime.datetime(2026, 3, 30, 15, 0, 22, 858063, tzinfo=datetime.timezone.utc)}
      2026-03-30 15:03:40 [scrapy.core.engine] INFO: Spider closed (finished)
      2026-03-30 15:03:40 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f011617b110>
      2026-03-30 15:03:40 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f011617b910>
    • Log

      /2/log/utf8/sourcing_v2/auto_selling_coches.net.api/4a46679c2c1f11f18e133aacc95538c6/?job_finished=True&ui=mobile

    • Source

      http://scrapyd-1:6800/logs/sourcing_v2/auto_selling_coches.net.api/4a46679c2c1f11f18e133aacc95538c6.log

  • sourcelog
    last update time2026-03-30 15:03:40
    last update timestamp1774883020
    downloader / request bytes117900
    downloader / request count61
    downloader / request method count / GET61
    downloader / response bytes4423604
    downloader / response count61
    downloader / response status count / 20060
    downloader / response status count / 4001
    elapsed time seconds197.375657
    feedexport / success count / FileFeedStorage1
    finish reasonfinished
    finish timedatetime.datetime(2026, 3, 30, 15, 3, 40, 233720, tzinfo=datetime.timezone.utc)
    item scraped count58
    log count / DEBUG843
    log count / INFO597
    memusage / max182743040
    memusage / startup147550208
    request depth max3
    response received count61
    scheduler / dequeued61
    scheduler / dequeued / memory61
    scheduler / enqueued61
    scheduler / enqueued / memory61
    scrape type / new58
    scrapy-zyte-api / 4290
    scrapy-zyte-api / attempts62
    scrapy-zyte-api / error ratio0.016129032258064516
    scrapy-zyte-api / error types / download / website-ban1
    scrapy-zyte-api / errors1
    scrapy-zyte-api / fatal errors0
    scrapy-zyte-api / mean connection seconds7.112289322810547
    scrapy-zyte-api / mean response seconds6.782125306666874
    scrapy-zyte-api / processed61
    scrapy-zyte-api / request args / actions2
    scrapy-zyte-api / request args / browserHtml2
    scrapy-zyte-api / request args / customHttpRequestHeaders59
    scrapy-zyte-api / request args / experimental.requestCookies60
    scrapy-zyte-api / request args / experimental.responseCookies61
    scrapy-zyte-api / request args / httpResponseBody59
    scrapy-zyte-api / request args / httpResponseHeaders59
    scrapy-zyte-api / request args / requestHeaders1
    scrapy-zyte-api / request args / url61
    scrapy-zyte-api / status codes / 20061
    scrapy-zyte-api / status codes / 5201
    scrapy-zyte-api / success61
    scrapy-zyte-api / success ratio1.0
    scrapy-zyte-api / throttle ratio0.0
    start timedatetime.datetime(2026, 3, 30, 15, 0, 22, 858063, tzinfo=datetime.timezone.utc)